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METHOD AND AI'PARATOS FOR 
PROVIDING AN OBJECT-ORIENTED 
APPLICATION INTERFACE FOR A 
COMPUTER SYSTEM 

This application is a continuation of U.S. patent appli- 
cation Ser. No. 08/898.768, filed Jul. 23, 1997, which is a 
division of U.S. patent application Ser. No. 08/482.314, filed 
Jun. 6. 1995, now U.S. Pat. No. 5,717,877. which is a 
continuation of U.S. patent application Ser. No. 07/996,171, 
filed Dec. 23. 1992, now abandoned. 

HELD OF THE INVENTION 

This invention generally relates to improvements in dis- 
play systems and more particularly to providing an object 
oriented operating system. 

BACKGROUND OF THE INVENTION 

Among developers of workstation software, it is increas- 
ingly important to provide a flexible software environment 
while maintaining consistency in the user's interface. An 
early attempt at providing this type of an operating envi- 
ronment Ls dLsclosed in U.S. Pat. No. 4,686,522 to Hernan- 
dez et ai. This patent discusses a combined graphic and text 
processing system in which a user can invoke a dynamic 
menu at the location of the cursor and invoke any of a variety 
of functions from the menu. This type of natural interaction 
with a user improves the user interface and makes the 
application much more intuitive. 

Object oriented applications should also reflect a consis- 
tent interaction interface with the user regardless of what 
application is currently active. None of the prior art refer- 
ences applicant is aware of provides the innovative hardware 
and software system features which enable all application 
object oriented appiicatioas to function in a consistent 
manner by architccting object oriented features into the 
operating system. 

SUMMARY OI' THE INVEN^FION 

Accordingly, it is a primary objective of the present 
invention to pawidc an innovative object oriented applica- 
tion interface. Users of an object oriented operating system's 
graphical user interface often move a mouse, click on 
objects to select them, drag objects to move or copy then, 
and double -click to open an object. These operations are 
called direct manipulations, or interactions. The sequence of 
events corresponding to a user pressing, moving, and releas- 
ing the mouse is called the input syntax. Certain sequences 
of events arc used to indicate particular actions, called 
semantic operations. This invention discloses the method 
and apparatus for traaslating input syntax into semantic 
operations for an object that supports Select, Peck, Move, 
AutoScToll. and Drag/Drop (Copy). 

Ihe invention detects a mouse button depression and then 
employs the following logic: 

(a) If an Option key was depressed when the user pressed 
the mouse button, the system enters drag mode by 
setting variable flnu^raciioniype to constant kOrag. 
'Vhc sy.stcm then commences a drag operation using the 
selected object as I he target of the operation; or 

(b) if the Option key was not depressed, then the system 
enters selection mode by setting variable flntcraction- 
'IVpe to a)nstant kSelccl. Hien, the select operation is 
commenced. 

If a user already had the mou.sc button depressed and 
continues to hold tlie mouse button down, then the following 
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logic is engaged. If the system is in select mode, then the 
system first determines whether the user has moved the 
mouse beyond a certain threshold, called the move thresh- 
old. This is done by comparing the initial mouse location, 
returned by the GetlnitialLocalion method, with the current 
mouse location, returned by the GctCurrentLocation 
method. If the mouse has moved beyond the move threshold, 
the system ends select mode and enters move mode. It does 
this by setting variable flnteractionType to constant kMove. 
The system then tells the object to terminate the select 
operation by calling its SelcctEnd method. The system then 
initiates a move operation by calling its MoveBegin method. 

Otherwise, if the mouse has not moved, the system checks 
how long the mouse has been down. It does this by com- 
paring the initial mouse down time, returned by the Getlni- 
tialUme method, with the current time, returned by the 
GetCurrenlTime method. If the mouse has been down 
beyond a certain threshold, called the peek ihreshokl, the 
system ends select mode and enters peck mode. It does this 
by setting variable flnteractionl^rpe to constant kPeek. It 
asks the object to end the select operation by callings its 
SelcctEnd method, and begins a peek operation by calling its 
PeekBegin method. Otherwise, if the mouse has not moved, 
or it has not been down beyond the peek threshold, the 
system continues the select operation by calling the object's 
SelectRepeat method. If the system detects that a user is in 
Move mode, the system first determines whether the user has 
moved the mouse within the window, on the border of the 
window, or outside the window. It does this by comparing 
the current mouse location, returned by the 
GelCurrentLocalionMethod, with the bounds of the object's 
container, returned by GetContainerBounds. 

If the mouse is still within the bounds of the window, the 
system continues the move operation by calling the object's 
MoveRepeat method. If the mouse is on the border of the 
window, this indicates an AutoScroll operation. The system 
asks the object's container to scroll in the direction indicated 
by the mouse location. This Ls done by calling the contain- 
er's AutoScroll method and passing the current mouse 
location as a parameter. Once complete, the system contin- 
ues the move operation by calling the object's MoveRepeat 
method. 

If the mouse has moved outside (he window, the system 
ends move mode and enters drag mode. It does this by 
.setting variable flnteractionType to constant kDrag. It asks 
the object to end the move operation by calling its MoveEnd 
method. It asks the object to begin the drag operation by 
calling its DragBegin method. If the system is in drag mode, 
the system continues the drag operation by calling the 
object's DragRcpcat method. If the system is in peek mode, 
the system first determines whether the user has moved the 
mouse beyond a certain threshold, called the move thresh- 
old. This is done by comparing the initial mouse location, 
returned by the Getlnitiall^cation method, with the current 
mouse location, returned by the GetCurrentl^cation 
method. 

If the mouse has moved beyond the move threshold, the 
system ends peck mode and enters move mode. It docs this 
by setting variable flnleraclionlVpe to constant kMove. It 
asks the object to end the peck operation by calling its 
Peek End method. It asks the object to begin the move 
operation by calling its MoveBegin method. Otherwise, if 
the mouse has not moved, the system continues the peek 
operation by calling the object's PcekKcpcat method. 

If the system detects that a user releases the mouse button, 
then if the system Ls in select mode, the sy.stcm ends select 
mode. It docs this by setting variable flnteractioniype to 
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conslani kNone. The system queries the object to end the DETAILED DESCRIPTION OF THE 

select operation by calling its SclectEnd method. If the INVENTION 

system is in move mode, the system ends move mode. It .j^^ j^^^^^j^^ preferably practiced in the context of an 

does this by setting vanablc nnlcr.clionTypc to constant ^ ^J ^ ^y^^ ^„ , ^ ^^^^ 

kNone. Then, the system queries the object to end the move S ,g^^ pg^^ Macintosh® computer. A 

operation by calling its MoveEnd method and ends drag ^epresenlaUve hardware environment is depicted in HO. lA, 

mode by setting variable f^nteract.onlVpe to cons ant m^^r^s^^ a typical hardware configuraUon of a 

kNone. It asks the object to end the drag operation by calhng ^„rtcstation in accordance with the subject invention having 

Its DragEnd method. If the system is m peek mode, ^e ^ processing unit 10. such as a conventional 

system ends peek mode. It docs this by setting variable lO „,icroprocessor, and a number of other units interconnected 

flnteractioniype to constant kNone. It^te the object to end ^ ^ ^ ^ workstation shown in FIG. lA 

the peek operation by calling its PcekEnd method. ^^^^^^ ^ ^^^^^^ ^^^^ ^^gj^ „^ 0„,y 

BRIEF DESCRIPTION OF THE DRAWINGS Memoiy (ROM) 16, an I/O adapter 18 for connecting 

peripheral devices such as disk units 20 to the bus, a user 

FIG. I A is a block diagram of a personal computer system interface adapter 22 for connecting a keyboard 24, a mouse 

in accordance with the subject invention; 26, a speaker 28. a microphone 32, and/or other user 

FIG. IB is a display in accordance with the subject interface devices such as a touch screen device (not shovra) 

invention; to the bus, a communication adapter 34 for connecting the 

FIG. 2 illustrates the tools used to create an applicaUon in ^ workstation to a data processing network and a display 

accordance with the subject invention; »'»»P'«' ^ connecting the bus to a display device 38. Tlie 

..... , . ■ workstation has resident thereon an operatmg system such as 

FIG. 3 IS a flow dugram of a command process in ^^ System/7® 



accordance with the subject invention; 

FIG. 4 is a checkbox control in accordance with the 
subject invention; 25 



operating system. 

The subject invention is a new object-oriented system 
software platform comprised of an operating system and 



RG. 5 is a checkbox control activation in accordance with development environment designed to revolutionize per 

the subject invention; sonal computing for end-users, developers, and system 

FIG. 6 Ls a checkbox update in accordance with the vendors. The system is a complete, standalone, native oper- 

subject invention; ating system and development environment architected from 

FIG. 7 is a summary of checkbox control processing in ground up for high-performance personal computing, 

accordance with the subject invention; The invention is a fully object-oriented system including a 

FIG. 8 Ls an illustration of a control panel in accordance ^^.^^ frameworks, class libraries, and a new generation 

with the subject invention; ""^^^^ programmmg enviromncnt, mtendcd to improve fun- 

„ . r . . . • . ic damentally the economics of third party application software 

HG. 9 an lUustralion of a dialog box in accordance with 35 ^^^^^^ ^y^-^^ invention is a fully portable 

the subject mvention; op^nling system. 

FIG. 10 is an illustration of a dialog box color controller Traditional operating systems provide a set of services 

m accordance with the subject mvention; ^^-^^ software developers can use to create their software. 

MG. 11 is an illustration of a radio button in accordance jheir programs arc very loosely integrated into the overall 

with the subject invention; operating system environment. For example, DOS applica- 

MG. 12 Is a detailed flowchart of menu stale processing tions take over the entire machine. This means that as far as 

in accordance with the subject invention; the user is concerned, the application is the operating 

FIG. 13 Ls a picture of a display in accordance m\h the system. In Macintosh® and Windows operating systems, 

subject invention; 45 applications feel and look similar and they typically support 

FIG. 14 illustrates the detailed bgic of atomic execution cutting and pasting between applicadons. This commonalty 

in accordance with the subject invention; makes it easier for users to use multiple applications in a 

IIG. 15 sets forth the detailed logic associated with smart ^^'^Sj^ enviromnenl. However, because tJie commonalty is 

label processing in accordance with the subject invcnUon; ""^ ^^.'^^^d, » ^\ «^ frameworks, it is sull 

. .u I . 1 1 1 • r * ' A 1 I I 5u very difficult to develop software. 

HG. 16 nrcsenis the detailed logic of smart window label ^" . . ... . .. „ . „ 

proce,ssing in accordance with the subject invention; subject im^sntion. wnling an application means 

*r . . • . . J J L *L creatine a set of objects that integrate into the operating 

FIG. 17 illustrates how objects are created and how the , . /or* j 1 1 <u 

... . , -.1. u .1. J • * • 1- . system environment. Software developers rely on the opcr- 

obicc s communicate wi h each other during a typical inter- , r l .1. * ^ . r * ^^ 

, , . . . . ...... alintt system for both a sophisticated set of .services and a 

action with an object that can be moved and selected in r i.ji L Tur^ i -u 

55 framework to develop software. The frameworks in the 

accordance with the subject invention; ^^^^.^^^ ^^^^^ -^^ p^^^f^^ ^^^^^^ abstracUons which aUow 

HG. 18 Ls an object generating notification flowchart for ^^^^^^^^ developers to concentrate on Uieir problem raUier 

a noUfication source object m accordance with the subject building up infrastructure. Furthermore, the funda- 

invention; mental abstractions for the software developer are very close 

I'lG, 19 presents a flowchart illustrating the detailed logic to the fundamental concepts that a user must understand to 

associated witli selecting the proper user interface clement in operate her software. This architecture results in easier 

accordance with the subject invention; development of sophisticated applications. 

FIG. 20 Ls a flowchart illustrating the detailed logic iiiLs section describes four steps to writing software 

associated with .scrolling in acairdancc with the subject employing tlic subject invention. A user contemplating the 

invention; and 65 development of an appHcation is typically concerned with 

I'lGS. 21 A, 21 B and 21C illustrate window scrolling in the following questions: 

accordance with the subject invention. What am 1 modchngV 
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For a word processor, this is the text I am entering; for a persistent selection corresponding to this selection, persis- 

spreadsheet, it is the values and formulas in the cells. lent selections are subclasses of an anchor object and may be 

How is the data presented? heavier weight than their corresponding ephemeral selec- 

Again, for a word processor, the characters arc typically tions because persistent selcctioas must survive editing 

displayed in a what-you-see-Ls-what-you-gel (wysiwyg) for- S changes. For example, a persistent text selection must adjust 

mat on the screen with appropriate line and page breaks; in itself when text is inserted before or after it. Anchors are 

a spreadsheet it Ls displayed as a table or a graph; and in a used in the implementation of hypermedia linking, dataflow 

structured graphics program (e.g. MacDraw), it is displayed linking and annotations. 

as a set of graphics objects. The baseclass also provides an override generic protocol 

What can be selected? lO for absorbing, embedding and exporting data contained in a 

In a word processing application, a selection is typically data encapsulator. Baseclasses are independent of the user 

a range of characters; in a structured graphics program it is interface technique used to create them. Selections are 

a set of graphic objects. typically created via direct manipulation by a user (e.g. 

What are the commands that can operate on this selection? tracking out a range of text or cells) but can be created via 

A command in a word processor might be to change the 15 a script or as a result of a command. This orthogonality with 

style of a set of characters to bold. A command in a the user interface is very important. Baseclasses also provide 

structured graphic program might be to rotate a graphic specific protocol for accessing the data encapsulator. There 

object. FIG. IB LS an illustration of a display in accordance is a very strong relationship between a particular subclass of 

with the subject invention. A command is illustrated at 41 for the encapsulator class and its subclass of a model selection 

bringing a picture to the front of a display. A presentation of 20 class. 

graphic information Ls illustrated at 40. Finally, a selection Finally: what arc the commands that can operate on this 

of a particular graphic object, a circle, is shown at 42. selection? In a word processing program, a command might 

A developer must answer the same four questions asked change the style of a selected range of characters and in a 

by the user, b^ortunatcly, the subject invention provides structured graphics program, a command might rotate a 

frameworks and services for addressing each of these four 25 graphic objea. The subject invention provides a large num- 

questions. 'ITie first question that must be answered is: What ber of buih-in command objects for all of the built-in data 

am I modeling? In a word processing program, the data types as well as providing generic commands for Cut, Copy, 

includes the characters that make up a document. The data Paste, Starling HyperMedia Links, Completing Links, Navi- 

in a spreadsheet includes the values and formulas in the gating Links, Pushing Data on Links, Pulling Data on Links, 

cells. In a calendar program, the data includes the times and 30 as well as many user interface commands, llie abstract 

appointments associated with a given day. llie invention baseclass that represents a command made by the user is 

provides facilities that help to model data. There arc classes responsible for capturing the semantics of a user action, 

for modeling specific data types including: text, structured determining if the command can be done, undone, and 

graphics, sound and video. In addition to these specific redone. Command objects are responsible for encapsulating 

classes, the invention provides a number of other abstrac- 35 all of the information necessary to undo a command after a 

tions that support problem modeling, including: collection command Ls done. Before a command is done, command 

classes, concurrency control, recovery framework, and the objects are very compact representations of a user action. 

C++ language. 'Hie class that encapsulates the data model Tlic baseclass is independent of the user interface technique 

for a particular data type provides a specific protocol for used to create them. Commands are typically created from 

accessing and modifying the data contained in the data 40 menus or via direct manipulation by the user (e.g. moving a 

encapsulator, support for overriding a generic protocol for graphic object) but could be created via a script. This 

embedding other data encapsulators and for being embedded orthogonality with the user interface Ls very important, 

in other data encapsulators, generating notification to all Benefits Of Frameworks 
regLstercd objecLs when the data changes, and overriding a 

generic protocol for creating presentations of the data. 45 The benefits of plugging into the abstractions in the 

The next question that must be answered is: how is the invention are greater than providing a conceptual model, 

data presented? In a structured graphic program, the set of Plugging into the framework provides many sophisticated 

graphic objects arc typically rendered on a canvas. In a features architected into the base operating system. This 

spreadsheet, it is ty})ically a table of cells or a graph; and in means that the framework implements major user features 

a presentation program it is a set of slides or an outline. The 50 by calling relatively small methods. The result is that an 

subject invention provides a "view" of the data contained in investment in coding for the framework is leveraged over 

a data encapsulator. The view is created using a "view several features, 

system" and graphic system calls. However, playing a sound w w i n t tv 

or video clip Ls also considered a presentation of the data. Multiple Uala lypcs 

Next: what can be selected? In a word processing 55 Once a new kind of data is implemented, the new data 

program, a selection Ls a range of characters; in a structured type becomes a part of the system. Existing software that can 

graphics program, it Ls a set of graphics objects; and in a handle data encapsulators can handle your new data type 

spreadsheet it Ls a range of cells. The invention provides without modification. This differs from current computer 

selection classes for all of the fundamental data types that systems, such as the Macintosh computer system. For 

the system supports. The abstract baseclass that represents a 60 example, a scrapbook desk accessory can store any kind of 

selection made by a u-ser provides an address .space inde- data, but it can only dLsplay data that has a text or quickdraw 

pendent spccificalitm of the daU selected. For text, this picture component. In contrast, the s-ubjccl invention's 

would be a numeric range of characters rather than a pair of scrapbook displays any kind of data, because it deals with 

pointers to the characters. 'Vhis distinction Ls important tlie data in the form of an olycct. Any new data type that is 

l)ccause selections are exchanged between other machines 65 created behaves exactly like the system -provided data types, 

when collaborating (in real-time) with other users. 'I1ic In addition, the data in the scrapbook is editable since an 

basecla.ss also overrides a generic protocol for creating a object provides standard protocol for editing data. 
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The scrapbook example highlights the advantages of data laboration policy decides whether users are forced to take 

cncapsulalors. If software is developed such that it can turns when changing data or can make changes freely. The 

handle data encapsulators, an application can be designed to invention handles the mechanics of collaboration which 

simply handle a new data type. A new application can removes the responsibility from an application developer. 



display and edit the new kind of data without modification 
Multi- level Undo 



Scripting 



Designing a system to manage the sequence of command 

Ihe invention is designed to support multi -level undo. objects also makes it possible to implement a systemwide 

Implementing this feature, however, requires no extra effort scripting facility. The sequence of command objects is 

on the part of a developer. The system simply remembers all equivalent to a script of the local actions. The scripting 

the command objects that are created. As long as the feature simply keeps track of command objects applied to 

corresponding command object exist, a user can undo a any document. The scripting facility also uses selection 

particular change to the data. Because the system takes care objects in scripts. This feature provides customization of a 

of saving the commands and deciding which command to script by changing the selection to which the script applies, 

undo or redo, a user does not implement an undo procedure. Since command objects include a protocol for indicating 

whether they can apply to a particular selection, the system 

Document Saving, Reliability, and Vcrsioning ensures that a user's script changes are valid. 

A portion of the data encapsulator protocol deals with Hvocrmcdia Linkinc 
filing the data into a stream and recreating the data at another 

place and/or time. The system uses this protocol to imple- Persistent selections, also known as anchors, can be 

ment document saving. By default, a user's data objects are connected by link objects. A link object contains references 

streamed to a file when saved. When the document is to the two anchors that fonai its endpoints. To the system, the 

opened, the data objects are recreated. The system uses a link is bidirectional; both ends have equal capabilities, 

data management framework to ensure the data written to Certain higher-level uses of links may impose a direction on 

disk Ls in a consistent slate. Users tend to save a file often so the link. The single link object supports two standard 

that their data will be preserved on disk if the system features: navigation and data flow. A user can navigate from 

crashes. The subject invention does not require this type of one end of the link to the other. Nonmally, this will involve 

saving, because the system keeps all the command objects. opening the document containing the destination anchor and 

The state of the document can be reconstructed by starting highlighting the persistent selection. The exact behavior is 

from the last disk version of the document and replaying the determined by the anchor object at the destination end. For 

command objects since that point in time. For reliability, the example, a link to an animation may play the animation. A 

system automatically logs command objects to the disk as link to a database query may perfonn the query, 

they occur, so that if the system crashes the user would not Links also faciliUle data flow. The selected daU at one 

lose more than the last command. end of the link can be transferred to the other end to replace 

Ihc invention also supports document versioning. A user the selection there. In most ca.ses, the efi'ect is the same as 

can create a draft from the current state of a document. A if the user copied the selection at one end, used the link to 

draft is an immutable "snapshot" of the document at a navigate to the other end, and pasted the data. The system 

particular point in time. (One reason to create a draft is to takes care of the details involved with navigating from one 

circulate it to other users for comments.) The system auto- end of a link to the other (e.g., locating the destination 

matically takes care of the details involved with creating a document, opening it, scrolling the destination anchor into 

new draft. view, etc.). Similarly, the system handles the details of 

transferring data across the link. The latter is done using the 

Collaboration . selection's protocol for accessing and modifying the data to 

As menti()nal above, a document can he reconstructed by 45 which it refers, 

starling with its state at some past time and applying the Annotations 
sequence of command objects performed since that time. 

Tliis feature allows users to recover their work in the case of The invention supports a system-wide annotation facility, 

a crash, and it can also be u.sed to support real -time col- Iliis facility allows an author to distribute a document draJt 
laboration. Command objects operate on selections, which 50 for review. Reviewers can attach posted notes to the 

arc address-space independent. Therefore, a selection object document, and when done, return the document to the 

can be sent to a collaborator over the network and used on author. The author can ther, examine the posted notes and 

a remote machine. 'ITic same is true of command objects. A take action on each. (An author can also create posted notes 

command performed by one collaborator can be sent to the in the document.) A reviewer need not have the same 
others and performed on their machines as well. If the ss software as the author. Instead, the reviewer can use a 

collaborators start with identical copies of the data, then standard annotation application. This application reads the 

their copies will be remain "in sync" as they make changes. data from the author's draft, and creates an annolatablc 

Creating a selection is done asing a command object, so that presentation of the data. (Creating such a presentation Ls part 

all collaborators have the same current selection. of the standard data encapsulator protocol.) 

Ihc system u.scs a feature known as "model based track- 60 The reviewer can create sclcctioas in the document, and 

ing" to perform mouse tracking on each collaborator's link posted notes to the selection. The link between the 

in ad line. Tlic tracker object created to handle a mou.sc press po.sted note and selection allows the system to position the 

creates and performs a scries of incremental commands as a posted note "near" the selection to which it refers. The links 

u.scr moves the mouse. Tliesc commands are sent to col- also make the annotation structure explicit, so that the 
laborators and performed l)y each collaborator. The result is 6S system can implement standard commands to manipulate 

that each collaborator sees the tracking feedback as it occurs, annotations. The contents of the posted note can be any data 

'Hie system alst) establishes a collaboration policy. A col- type implemented in the system, not simply text or graphics. 
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The contents of a note is implemented using a data within the cncapsulator. The presentations include a thumb- 

cncapsulator, and opening a note results in creating an nail presentation, a browse-only presentation, a selectable 

editable presentation on that data. presentation, and an editable presentation. There is also a 

Data Representation protocol for negotiating sizes for the presentations and 

5 fitting the data into the chosen size. Subclasses of the 
Data representation Ls concerned with answering the cncapsulator class arc responsible for overriding and implc- 
question of what is the data that I am modeling? The subject menting this protocol to support the embedding of the data 
invention provides facilities that help to model data. There ^jj^^^ encapsulators. The presentations currently sup- 
arc classes for modeling specific data types, including: text, ported include: 

structured graphics, sound and video. In addition to these Thumbnail— This presentation is intended to give the user a 

specific classes, the mvenlion provides a number of other ^^^^ contained in the cncapsulator. It is 

abstractions that help to model a problem: the collection typically smaU in size and may scale-down and/or cUp the 

classes, the concurrency control and recovery framework, ^j^j^ ^ gj^^ 

and the C^-^ language itself. In the subject invention, the Browse-only— This presentation allows the user to view the 

class that encapsulates the data model for a particular data -^^ noxmil size but the user is unable to select or 

type is a subclass of the cncapsulator class, modify any of the data. 

The Encapsulatnr Class Selectable — ^This presentation adds the ability to select data 

I . f « t,«^ «f to the capabilities provided by the browsc-only presenta- 

A developer creates a container for a particular type of . _ . »^ . . ^ , ' „ . f l j 

^ ^ ^. . . j ji r.u tion. It IS used m annotatmg to allow annotations to be tied 

dau rcprcscnUUon by creatmg a derived c ass of the «:n«.p- ^ ^^^^^^ modification to 

sulator class. For ead, type of data m the system (eg ^ .^^^^ presentation is typically 

graphic objects, s yled texU spreadsheet ceUs) a different ,,„,„i,d ^ , ,„bclass of the browse-only presenU- 

derived class must exist which acts as the container for ^ j-^Jj 

type's data. Each cla.ss of cncapsulator Provides a type presentation adds the abiUty to modify data 

specific protocol (or accessing and modifying t^^^^^ to the capabilities provided by the selectable presentaaon. 

contained Ihcre.n. IT,. s protocol .s typically used by prcsen- presentation that allows the user create new 

talioas for displayina the data and by commands tor modi- . ^ . j . - j . ^r, .l- . ,• 

r • J / 1 j^ *' . . . data and edit exisUng data. Currently, this presentaUon 

fyina the data. In addition to type specific protocol, the - f c j *- u ' n i . • *u 

' ^ , , ., • . 1 . providesitsovm window for editing. It IS likely that m the 

enc.p.suIalor cks« provides generic pro ocol that supports ^,„resupport will be added for presentations which aUow 

the embeddme of data encap.sulalors as black-boxes into ^ ^^.^^^^^ presentation is typically 

other a hen types. This protocol must be implemented in the i . \i „u i «f «i,r^»u^.oKi-* «r-r.;«#ot;«« 

, . . , . f . implemented as a subclass of the selectable presentation, 

derived class to support the creation of presentatioas, editors ^ 

and selections for the encapsulated data. A container need Change Notification 

only understand Ihh generic protocol to support the embed- ^^^^ ^^^^ ^^^^^^^^ ^ cncapsulator class is 

dmg o! any alien data type. changed, it is necessary to provide clients (e.g. a view on the 

Choosing A Representation For Data data) with notification of the change. Encapsulators rely on 

'Ihc data type designer has both the C++ object model, a built-in class for standard notification support to allow the 

and a rich set of standard classes to choose from when encapsulator to notify clients of changes to the data rcpre- 

dcsigning a representation for a particular type of data. The scnlation. A chent can ainnect to an encapsulator for noU- 

classes provided by the invention should always be consid- fication on specific changes or for all changes. When a 

crcd before designing unique classes to represent the data. change occurs the encapsulator asks the model to propagate 

mis minimizes any duplication of effort which may occur notification about the change to all interested clients, 

by creating new classes which provide similar or identical p^^^ Presentation 
function to classes already existing in the system. The most 

basic of these is the C++ object model. A designer can create 45 ThLs section addresses how the system presents data to a 

a class or classes which closely match the mental model of user. Once the data has been represented to the system, it is 

the user to represent the cla.sscs the user deals with. the rolc^of the user interface to present the data in an 

Tlie invention's foundation classes provide many stan- appropriate and meaningful way to a user. The user interface 

dard ways to represent data. Collection classes provide a establishes a dialogue between the user and the model data, 
number of ways for collecting together related objects in 5" This dialogue permits a user to view or otherwise perceive 

memory, ranging fmm simple sets to dictionaries. Disk- ^ala and gives a user the opportunity to modify or manipu- 

based collections, providing persistent, uncorrupted collec- »ate data. This section focuses on data presentation, 

lioas of objects, are also available. A data type requiring two yj^^ yg^.^. [ntcrface 

(2D) and three dimensional (3D) graphic modeling, .such as . ^ .,. . ■ r 
a graphical editor, is also .supported. Numerous 2D and 3D 55 A developer creates a class to facilitate the prescnlalion of 

modeling objects are provided along with transformation, ^^^^ »"«cract with a data encapsulator By separating the 

matrix cUsscs and 3D cameras. Similarly, the invention data model from the presentaUon. the invention facilitates 

provides a sophisticated text data type that supports full multiple presentations of the same data. Some apphcaUoas 

international text, aesthetic typography, and an extensible like the AppleOD Macintosh Finder, already support a limilcd 
style mechanism. ITie invention also provides support for ^0 form of multiple presentations of the same data. SomeUmcs 

time l)a.scd media such as sound and video. St,phLsticated i-'^ "•^<=f^» ^ ^^^^ ^'^^^^y d^ff!^^"^ ^^'^^^ ^""^""'^^ 

lime amtrol mechanisms arc available to provide synchro- ^^ta at the same time, 'nicsc different views might be 

ni/.ation between various types of Ume based media. instances of the same class-as ma 3D CAD program which 

shows four diflcrent view of the same data, lor each kind of 

Presentation IVotoail presentation, a user was previously required to write a view 

Ihcencap.sulator class provides a pro ti^ail for the creation which can display the model and a set of trackcis and 

of various cla.sscs of presentations on the data uinlained tracking commands which can select and modify the model. 
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Static Presentatioas . Data Access 

The simplest presentation type is the name of the data. Presentations interact with data encapsulate rs in order to 

The name is a text string that indicates the data content or determine the data and other information to present. Pre- 
typc. Examples include "Chapter A", " 1990 Federal Income ^ sentations query the model for the data that is required. The 

Taxes", "To Do". Another simple presentation type, an icon, presentation may present all or only part of the data that is 

is a small graphical representation of the data. It usually contained or can be derived from the data in the data 

indicates the data type. Examples are a book, a report, a encapsulator. 
financial model, a sound or video recording, a drawing. m « • 

However, they may also display status, such as a printer that Change NotificaUon 

is printing, or indicate content, such as a reduced view of a Because there can be many presentations of a single 

drawing. Finally, the thumbnail, is a small view of the model model active at once, the data can be changed from many 

data. This view may show only a portion of the data in order sources, including collaborators. Each presentation is 

to fit the available space. Examples are a shrunken drawing, responsible for keeping itself up to date with respect to the 

a book's table of contents, a shrunken letter, or the shrunken model data. This is accomplished by registering for notifi- 

first page of a long document. A browse-only presentation cation when all or a portion of a model changes. When a 

allows a user to view the data in its normal size but the user change occurs to data in which the presentation is interested, 

Ls unable to select or modify any of the data. the presentation receives notification and updates its view 

accordingly. Change notification can be generated in any of 
Selectable PresentaUons ^^yg ^^^^^ ^^^^^ pj^gi^ change notificaUon can be 

Selectable presentations allow a user to view, explore, and generated from the method in the data encapsulator which 

extract informaUon from the daU. These presentations pro- actually changes the model data. Second, change notificaUon 

vide context; what the data is, where the data is, when the can be generated from the command which caused the 

data was. It may help to present the data in a structured way, change. As mentioned earlier, there are benefits to these two 
such as a list, a grid, as an outline, or spatially. It is also 25 approaches. Generating the notification from within the data 

useful to display the relationships among (he data elements, encapsulator guarantees that clients be notified when- 

the data's relationship to its container or siblings, and any ever the data changes. Generating the notification from the 

other dependencies command allows "higher-level" notification, and reduces the 

Selectable presentations may also display meta data. An ^"^0^ «^ notifications produced by a complicated change, 
example is the current selection, which indicates the data 30 Notification Framework Overview 

elements a user is currently manipulating. Another type of 

meta data is a hypermedia link between data elements. The The NoUflcaUon framework provides a mechanism for 

view may also indicate other users who are collaborating on propagating change information between objccU. The 

the data framework allows objects to express interest in, and receive 

o 1 . LI 4 4- 11.. .. «, ™^;fi-^ *u* IS notification about changes in objects on which they depend. 

Selectable presentations are usually very specific to the -^^ j <• i ,1. » a 

c*u A* . I- r ..r;«X.««. iM-^.wc «r,H A standard interface is provided for classes that provide 

type of the data, Iney are made up of wmdows, views, and vi .-c 1 -j *'r 

\l r L- . u'^uL,„K. t„j,<.c# notification to clients. Notificr classes provide notification 

other user mtcr face objects which may be customized to best . - ... . i- * r i- . 1 

fl * «u At c«,«« ^^^ry^r^i^c^ ,r^. sourcc objccts With the means to manage lists of clients and 

reflect the data type. Some examples are: J ... i- . kt *r 1 • * 

, , , ,j r i- dispatch notifications to tho.se clients. Notifier objects 

Sound recordmg-A control panel would facilitate an require no special knowledge of the class of objects receiv- 

audible presentation. Views would display the sound as . notifications. Connection objects provide the dispatch of 

a musical score or as a series of waveforms. Views may jj^^Jifi^.tjons from the notifier to specific notification receiver 
include a sample number or lime indications. connection objects allow specialization of 

Financial model.— 'ITic model could be viewed as the set notifications are dehvered to different classes of rcceiv- 

of formulas and other parameters. It could display Finally, Notification objects transport descripUve infor- 

valucs from the model at a particular instance of Umc mation about a change, and interests describe a specific 

or with specific input values as a spreadsheet or in notification from a notification source object, 
various graphical forms. 

liook.— The model could be viewed as a table of contents, Notification Propagation Flow Chart 

an index, a list of illustrations. It could be viewed as a pjQ ijj ^n object generating notification flowchart for 

scries of pages, a series of chapters, or a continuous text ^ notification source object. Processing commences at ter- 

flow. minal 1800 and immediately passes to function block 1810 

Video recording — ^The model could be viewed as a series where a notification receiver object creates a connection to 

of individual frames or as a continuous presentation. itself. Then, at function block 1820 the notification receiver 
Views may include track marks, frame number, and 55 object adds appropriate interests for one or more notifica- 

limc indications, tions from one or more notification source objects. These 

Cbntaincr containing other objects — The objects could be interests are defined by tlie notification source object(.s). 
displayed alphabetically by name, by type or other The client object asks the connection object to connect to 

attribute, as a set of icons, as a set of thumbnails. ihe notification source(s) for notifications specified by the 

60 interests in the connection in function block 1830. Then, in 

Editable Presentations function block 1840, for each interest in connection, the 

Editable presentations arc similar to interactive prcscnta- connection is registered as interested in the notification with 

tions except that they atso facilitate data modification. Vhoy the notificr in the interest. Next, at function block 1845, the 

do this by allowing direct manipulation of Uic data with the system enters a wait stale until a change is detected. When 
mouse or other pointer. 'Hicy also allow the data to be 65 a system change occurs, control immediately passes to 1850 

manipulated symbolically through menu items and other where a notification source object changes and calls notify 

contn)ls. on its notifier with a notification describing the change. 
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For each connection registered with the notifier as inter- AdoptData must be implenaented by the derived class to 

ested in the notification, at function block I860, the con- support absorbing or embedding data into the specification's 

nection is asked to dispatch the notification. In turn, at associated representation. If the data is to be absorbed it 

function block 1870, the connection dispatches the notifi- must be of a type which can be incorporated directly into the 

cation to the appropriate method of the notification receiver. 5 receiver's representation. The absorbed data is added to the 

Finally, at function block 1880, the notification receiver representation as defined by the specification. It is common 

takes the appropriate action for the notification, and a test is for many data types to replace the currently specified data 

performed at decision block 1885 to determine if another with the newly absorbed data. Any replaced data is rctumcd 

connection is registered with the notifier as interested in in a data encapsulator lo support Undo. If the data is to be 

notification. If there is another connection, then control lo embedded, the encapsulator is incorporated as a black box 

passes to 1850. If there is not another connection to service, and added as a child of the representation, 

then control passes to function block 1845 to await the next ClearData must be implemented by the derived class to 

change. delete the specified data from the associated representation. 

^ „ . _ , An encapsulator of the representation's native type contain- 

Data Specification 15 ^^j^^^j ^^^^ ^^^^ returned. 

Data specification addresses the selection issue of data 

processing. If a user must manipulate data contained in a ^scr Interface 

representation, the data must be able to specify subsets of interface for creating specifications is typically 

that data. The user typically calls this specificaUon a Uie responsibility of a pieseauaon on the data. A number of 

"selection," and the system provides a base class from which mechanism arc available depending on data type and pre- 

all selection classes descend. The mvenUon also provides sentaUon style. The most favored user interface for creating 

selection classes for all of the fundamental data types that ^ selection is direct manipulation. In a simple graphics 

the system supports. j^odel, objects may be selected by clicking direcUy on the 

Model Selection 25 ^^i^^^ mouse or dragging a selection box across 

several objects using a mouse tracker. In text, a selection 

The object which contains the specification of a subset of may be created by as the result of a find command. Another 

data in a representation is a model selection class. In the case common way that selections arc created is as a result of a 

of a text representation, one possible selection specification menu command such as "find." After the command is issued, 

is a pair of character ofiEsets. In a structured graphics model, the document is scrolled lo the appropriate place and the text 

each shape must be assigned a unique id, and the selection that was searched for is selected. 

specificaUon is a set of unique ids. Neither of the specifi- FinaUy, selections can come from a script (or program- 
cations point directly at the selection data and they can be matically generated) and the result would be the same as if 
applied across mulUple copies of the data. created the selection direcUy. "Naming" selecUons for 
Accessing Specified Data scripts involve creating a language for des^^^^ 

^ * tion. For example, m text, a selection could be the second 
A selection understands the representation protocol for word of the fourth paragraph on page two." The invention's 
accessing and modifying data and knows how to find data in architecture provides support for scripting, 
a local address space. Command objects access a represen- 
tation's data through data selection, and therefore require no 40 Data Modification 
knowledge of converting from specification to the real data Modificatioas addresses the question: what are the 
m the local model. It is the job of the selection object to ^„ ^-^^ If ^ 
provide access to the rca daU from the address space ^^^.^ ^^^^ contained in a representation, the system 
independent specification. In a text encapsulator Uiis pro- ^^^^ ^^^^ ^ modificaUon lo 
ce.ssing may require querying the encapsulator for the actual ^^^^ ^ ^ ^^^^ processing program, a user 
characters contained in a range, n a base model such as a ^^^^ ^ ^ ,^ ^ ^^I^^^^ ^^^^^ 
graphical editor the selection will typical y hold surrogates ^^^^^ ^ ^^^^^^^^ ^ ^^^^ 
or the real objects. ITie encapsulator must provide a lookup ^^.^^ ^^^^^.^^ ^ ,| ^^^^^^ ^j,/^ 
facility for converting the surrogate to the real object. ^^^.^.^ ^^^^ coni^in^ in. a data encapsulator are rep- 
Standard Editing Protocol resented by "command objecLs." 

The model selection class provides a protocol for the j^c Model Command Object 
exchange of data between selections. By implementing the 

protocol for type negotiation, absolving, embedding and The abstract base class that represents a command made 

exporting data, derived classes provide support for most of ss command object. Subcla.sses of the 

the standard editing commands. This means that the editing model command object capture the semantics of user 

commands (Cut, Copy. Paste, Push Data, etc.) provided by ^^^^ as: can be done undone, and redone. TTiese 

the system will function for the represented data type and subclasses arc mdcpendcnt of the user mtcrface technique 

will not require reimplemcniation for each application. Ilie to create them. Unhkc MacApp. as soon as the scman- 

modcl selection class also provides support direcdy for the 60 ^ ""^^ translated 

exchange of anchors and links but relies on the derived command objects by the system. 

class's implementation of several key methods to support i, 1 ^ . i n n a 

. . ' f . , „», I.. HandlcDo, Hand cUndo, and HandleRedo 
the exchange of the representation s data: 

QjpyData must he iinpleriientcd by the derived class lo Creating a new class of command involves overriding a 

export a copy of the specified data. The implementation 65 number of methods. The most important three methods to 

creates and returas a new data encapsulator of the requested override are: HandlcDo, HandlcUndo and HandleRedo. The 

type containing a a)py of the specified data. HandlcDo method Ls responsible for changing the data 
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encapsula(or appropriately based on the type of command 
that it is and the selection the command is applied to. For 
example, if the command involves a style change to a range 
of characters in a word processor, the I-IandlcDo method 
would call a method (or set of methods) in the data encap- 
sulator to specify a character range and style to change. A 
more difEcult responsibility of the HandleDo method is 
saving all of the information necessary to "undo" this 
command later In the style change example, saving undo 
information involves recording the old style of the character 
range. The undo information for most commands is very 
simple to save. However, some commands, like find and 
change may involve recording a great deal of information to 
undo the command at a later lime. Finally, the HandleDo 
method is responsible for issuing change notification 
describing the changes it made to the data encapsulator. 

The HandleUndo method Ls responsible for reverting a 
document back to the state it was in before the command 
was "done." The steps that must be applied are analogous to 
the steps that were done in the HandleDo method described 
above. The HandleRedo method is responsible for "redoing" 
the command after it had been done and undone. Users often 
toggle between two states of a document comparing a result 
of a command using the undo/redo combination. Typically, 
the HandleRedo method is very similar to the HandleDo 
method except that in the Redo method, the information that 
was derived the last time can be reused when this command 
is completed (the information doesn't need to be recalcu- 
lated since it is guaranteed to be the same). 

User Interface 

Command objects capture the semantics of a user action. 
In fact, a command represents a "work request" that is most 
often created by a user (using a variety of user interface 
techniques) but could be created (and applied) in other ways 
as well. Tlic important concept Ls that command objects 
represent the only means for modifying the data contained in 
a data encapsulator. All changes to the data encapsulator 
must be processed by a command object if the benefits of 
infinite undo, save-less model, and other features of the 
invention arc to bo reafized. 

The most favored user interface for issuing commands 
involves some sort of direct manipulation. An object respon- 
sible for translating device events into commands and "driv- 
ing" the user feedback process is known as a tracker. The 
invention provides a rich set of "tracking commands" for 
manipulating the built-in data types. For example, there are 
tracking commands for rotating, scaling and moving all the 
2D objcctii in Pink such as lines, curves, polygons, etc. 

A wmmon u.scr interface for Issuing commands is via 
contmls or the menu system. Menus are created and a set of 
related commands arc added to the menu. When the user 
chooses an item in the menu, the appropriate command is 
"cloned" and the Do method of the connnand is called, llic 
programmer is never involve*! with device events at all. 
Furthermore, because commands know what types of selec- 
tions they can be applied to, menu items are automatically 
dimmed when they are not appropriate. 

F'inally, commands can be Lssucd from a .script (or pro- 
grammatically generated) and the result would be the same 
as if a user Lssucd the connnand directly. 'Hie Pink archi- 
tecture provides support for scTipting; however, at thLs time, 
(here Ls no user inlcrfacc available for creating these scripts. 

Huilt-in Commands 

The invention provides a large number of built-in com- 
mand (»bjecLs for all of tlic built-in data types as well as 



providing generic commands for Cut, Copy, Paste, Starting 
HyperMedia Links, Completing Links, Navigating Links, 
Pushing Data on Links, Pulling Data on Links, as well as 
many user interface commands. One of the advantages of 
using the frameworks is that these built-in command objects 
can be used with any data encapsulators. 

More Features 

The previous sections of this document concentrated on 
the foundational features of the invention. There are many 
additional facilities in the invention that implement 
advanced features. Specifically, these facilities include: 
model-based tracking, filing, anchors, and collaboration. 
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Model Based Tracking 

Tracking is the heart of a direct -manipulation user inter- 
face. Tracking allows users to select ranges of text, drag 
objects, resize objects, and sketch objects. The invention 
extends tracking to function across multiple views and 
muhiple machines by actually modifying the model. The 
tracker issues commands to the model, which posts change 
notifications to all interested views. 

Model based tracking is the best solution for tracking in 
dociunenls, but it does have the drawbacks that: (1) the 
model's views must be optimized to provide quick response 
to change events and (2) the model must be capable of 
expressing the intermediate track states. 

Anchors 

Persistent selections or "anchors" are very similar to 
selections in that they are specifications of data in a repre- 
sentation. The dififcrcnoc is that anchors must survive editing 
changes since by definition anchors persist acrpss changes to 
the data. The implementation of graphics selections 
described earlier in the document is persistent. The imple- 
mentation of text selections, however, is not. If a user inserts 
or deletes text before a selection, then the character oSsets 
must be adjusted. There are a couple of approaches for 
implementing text anchors. First, the text representation 
maintains a collection of markers that point within the text, 
similar to the way styles arc maintained. The anchors 
include an unique id that refers to a marker. When the text 
Ls changed, the appropriate markers arc updated, but the 
anchors remain the same. Another approach is to maintain an 
editing history for the text. The anchor could contain a pair 
of character positions, as well as a time stamp. Each time the 
text was edited, the hLstory would be updated to record the 
change (e.g., 5 characters deleted from position X at time 'I^. 
When the anchor is used, the system would have to correct 
its character positions based on editing changes that hap- 
pened since the last time it was used. At convenient limes, 
the hLstory can be condensed and the anchors permanently 
updated. 

The system provides a large number of features for "free" 
through the anchor facility. All of the HyperMedia com- 
mands (Create Link, Push Data, Pull Data, and Follow) all use 
anchors in their implementation. The implementation of the 
system wide annotation facility uses anchors in its imple- 
mentation. The base data encapsulator provides services for 
keeping track of anchors and links. However, the user is 
responsible for making anchors vLsiblc to the user via 
presentations. The application must also issue the proper 
command object when a user selects an anchor. After a user 
interface for anchors and links is nailed down, the document 
framework provides additional support to simplify process- 
ing. 
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Filing with the user, the control updates the command 's parameters 

, . . • J . . J and causes it to be executed. For example, a checkbox sets 

I'lhng IS the process of saving and restoring data to and ^ command parameter to on or off and then executes the 

from permanent storage. All a user must do to make fihng ^^^^^^^ ^ ^ ^ ^^^^ ^^^^^ 

work IS to miplement the streaming operators for a data . i j- i ,i. . ■ f .i. j . .u . 

encapsulator. The invention's default filing is "image" ' Many consols display the current value of the data Ihcy 

based. When a user opeas a document, the entire contents of manipulate. For example a check box displays a check only 

the document are read into memory. When a user closes a ^hen a Boolean data value is TRUE. As the daU changes, 

document, the entire contents of the document are written ^n"^"' ' "PP"'"""? ^t, \ "° 1*' 

back to dusk. This approach was selected because it is 1'°" system dcscnbcd here The process is similar to the 

simple, nexible, and easy to understand. To store data in a Pf°««* "^o" »» enable/dwable menu items, 

different format, perhaps for compatibility with a preexisting When a control is created a command must be specified, 

standard file formal, two approaches are possible. First, an The control makes a copy of this command and stores it in 

encapsulator class can stream a reference to the actual data, field fCommand. If the command supplies any daU values, 

then use the reference to find the actual data, or a new a pointer to appropriate Get and Set methods of the com- 

subcla.ss can be defined to create and return a file subclass. mand must also be specified. The control stores these 

TTie advantage of the first approach Ls a data encapsulator ^^^°<\. f^^}^ ^ fCetMethod and fSetMetbod 

can be encapsulated in other documents. The advantage of respecUvely^Tlien. Uic control connecU for notifications that 

the second approach is the complete freedom afforied to ■"<»«=.f "a a value may be ou of date^ ^f„Zr 

exacUy match an existing file format for the complete ^ provides a method called ConnectData for this purpose, 

document. ^^^^ control contains a connection object called fData- 

Connection indicating the object and method to receive the 

Collaboration notification. This connection object passed as an argument to 

„ . w the command. The command object calls the connection 

Same-time network coUaboration means that two or more *" J „„*;fi^r .ni.r^.. 

, ... . . * cwei^m n< object's Connect method to add each notificr and interest 

pcop c edit the same document at the same time. The system 25 .\ ^ . u/k-« ^ntr^i 

. . LI- 11 t- *■ ^i ..... *u„t .„u^tu^^ that may affect its data value. When complete, the control 

also estab Lshes the collaboration policy that is, whether „ ^ u-^«... ^ 

f J * . 1 * u .h- ^,1, «r r,^« calls the connecUon object's Connect method to establish 

uscn, are forced to take turns when changing ttie data o^ can connections as shown in FIG. 3. The control updates its 

make changes freely. A ^'^''^^J^'^^^J"'}^^^^^ data value from its command. It does this by calling the Get 

about the mechamcs of collaboration or the collaboration ^ ^^^^^ ^^^^^ (fCommand-*CfGetMethod)0). 

V^^^^y- The control stores this value in an appropriate field (e.g. a 

Supporting Collaborator Selection Styles checkbox stores it in a Boolean field named fChecked) as 

depicted in BG. 5. Then, the control updates its appearance. 

To assist in the reduction of confusion and enhance model performs this action by calling the view system's invali- 

selection, the document architecture provides a collaborator j^j^ method, indicating which portion of the screen needs 

cla.ss which contaias information about the collaborator's yp^^^jj^g 

initials and preferred highlight bundle. ^.^^j^^^ ^^^^ ^^^^^^^ notification is sent. At some 

Supporting Multiple Selections poini, a command is executed which changes the value of 

the data being reflected by the control. This command could 

lb support multiple selections a user must modify pre- executed from a control, menu item, or through direct 

scntalion views because each collaborator has a selection. manipulation, llic control receives the notification as shown 

When the active collaborator's selection changes the stan- 4^ control is passed to await the next user 

dard change notification Ls sent. When a passive collabora- selection, 
tor's selection changes a difi"ercnt notification event Ls sent. 

A view should register for both events. Since the action Control Panel 

taken to respond to either event is usually the same. r . t • n ^ .1 ■ m. 

ca)nomy can be realized by registering the same handler One collection of controls is called a control panel. The 

nicUiod for both events. controls in a control panel lypicaUy operate upon actual data 

(this Ls the default, not a requirement). Tlieir actions are 

User Interface In Accordance With llie Invention usually immediate and arc independent from one another. 

, , , . 50 Ointrol panels manage the progression of the input focus 

lliis portion of the mvemion ts primarily focused on ^ >^ ^ necessary. It Ls likely that control 

innovative aspecLs of the u.ser interface building upon the ^.^^ ^^^^^^ ^^^^ ^^^^ interfaces in the system, 

foundation of the operating system framework previously ^ 

dLscusscd. The first a.spcct of the user interface Ls a mccha- . Dialog Box 
nLsm allowing a user to manage interactioas with various 55 

objects or data referred to as controls. Another collection of controls is called a dialog box. The 

controls in a dialog box typically operate upon prototypical 

Control data (this is the default, not a requirement). Their actions are 

ihc object with which users interact to manipulate other usually collected together into a group arid then performed 
objects or data Ls called a control. Controls use a command 60 together when the user presses an Apply button. Dialog 

U> determine the current state of the object or data. Follow- boxes manage the progression of the input focus among its 

ing appropriate interactions with the user, the control controls as necessary, 

updates the command's parameters and causes it to be \c \ \ ' A \' 

executed. L xample controls arc menus, buttoas, check boxes ^ K^omoi in Action 
and radio buttons. 65 it We would now like to present a play in three acts to 

Q)ntroIs use a command to determine the current is state illustrate a control in action. FIG. 2 illustrates the various 

of the object or data. Following appropriate if interactions controls, A play example will be used by way of analogy to 
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illustrate a control (in this case a checkbox), a command, a 
selection, and a data encapsulator. 

Checkbox 200 The role of the checkbox is to display a 
Boolean value stored in the data encapsulator and to 
facilitate its change. The value is represented by the 5 
presence or absence of a check. 

Command 210 The role of the command is to obtain the 
value from the data encapsulator and change it upon 
direction from the checkbox. 

Selection 220 The role of the selection is to be an interface lo 
between the command and the data. 

Data 230 Data is employed as a target for actions. 

Getting to Know You 

Everyone gets lo know each other a little better as shown 
in FIG, 3. The command 310 tells the checkbox 300 which 
notifications the data may send in which the control is 
certain to be interested (how the command 310 knows is 
none of anyone else's business). The checkbox 300, in turn, 
connects to the data 320 for the notifications. ^ 

Unknown to anyone else, the director told the checkbox 
300 the best way to interact with the command 310. 
Specifically, it was told about the command's gel value 
method and a set value method. The checkbox will take 
advantage of this a little bit later. 

Reflecting the Data 

Something happens to the data — it sends notifications as 
depicted in RG. 4. The checkbox 400 hears about those for 30 
which it has expressed an interest. In FIG. 4, the notification 
from the data expresses to bold the information which is 
reflected by placing an X in the checkbox. 

The checkbox 510 received notification from the data, and 
the processing to display the checkbox 510 correctly is 35 
depicted in FIG. 5. It does this by using the command's 520 
get value method it happcas to know about. Before tclhng 
the checkbox 510 what the correct value Is the command 
520 goes through the selection to the data to make sure it 
really knows the correct value. The checkbox 510 updates 40 
itself as necessary. 

Changing the Data 

The user now enters the scene and gives the checkbox 600 
a nudge as shown in FIG. 6. VUc checkbox 600 uses the 
command's 610 set value method to set the data's 620 value 
tlirough the selection. The entire process is reviewed in HG. 
7. 

A Control Panel in Action 

A control panel is nothing more than a simple window that 
conlaias a set of controls as shown in FIG. 8. These controls 
contain a amnnaiid that operates upon the current selection. 
The control is enabled if the ct^mmand is active. Following 55 
appropriate interaction with the user, the control executes 
the command, causing the data to change. 

A Sound Control Panel 

As an example control panel, con.sidcr the sound control- 60 
Icr illustrated in FIG. H. This control panel contains four 
buttons 800, 802, 804 and 806 for u>ntrolling stmnd play- 
back, liach button performs as described in the "A Control 
in Action" section alxwe. 

Play 800 'Hiis control contains a 'IIMay command. 'ITiis 65 
command is active only under certain conditions, making 
the control enabled only under those conditions. First, a 
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sound must be selected in the appropriate data encapsu- 
lator. Next, it must not be playing already. Finally, the 
current sound position must be somewhere before the end. 
When pressed, the Play button executes the TPlay 
command, causing the selected sound to come out of the 
speaker. 

Step 802 This control contains a TPlay command, too. How 
is this, you ask? Well, since I am making this up, we can 
pretend that the TPlay command takes a parameter indi- 
cating the duration it is to play. For the purposes of the 
step button, it is set to a single sample. The Step button is 
enabled only under the same conditions as described for 
the Play button. When pressed, the Step button executes 
the TPlay command, causing the selected sound lo come 
out of the speaker. 

Stop 804 This control contains a TStop command. The Stop 
button is enabled only if the selected sound is currently 
playing. When pressed, the Stop button executes the 
TStop command, causing the selected sound to stop 
playing and to set the current sound position to the 
beginning. 

Pause 806 This control contains a TStop command, too. 
UnUkc the Stop button, however, this TStop command is 
set to not rewind the sound to the beginning. Pressing the 
Play or Step buttons continue from where the playback 
left off. 

A Dialog Box in Action 

A dialog box is similar to a control panel, in that it is a 
simple window containing a set of controls. However, 
instead of the controls operating upon the selected data, they 
operate upon parameters of another command. Only until 
the Apply button is pressed is the real data modified. 

A Color Editor 

As an example dialog box, consider the color editor set 
fortli in FIG. 9. It contains three sliders, one for the red 900, 
blue 910, and green 920 components of the color. After 
adjusting the sliders to the desired values, the user presses 
Apply 930 to change the color of the selection. 
Red 900, Green 910, Blue 920 To the user, these sliders are 
identical, except for their label. As with all controls, each 
slider contains a command that is executed following user 
interaction. Unlike many controls, especially those in a 
control panel that immediately affect the selected data, the 
command contained by these sliders displays and modi- 
fies the value of a parameter of another, command. In this 
case, it is one of the red, green, or blue parameters of the 
command contained within the Apply button. 
Apply 930 The Apply button contains a TSctColor command 
that changes the color of the selection when executed. It 
has three parameters, one for each of the red, green, and 
blue components of the color. These parameters are 
displayed and set by the sliders in response to user 
interaction. When the Apply button is pressed, this com- 
mand is executed and the new color Ls set. The internal 
actions accompanying the color editor example, arc 
depicted in FIG. 10. The Red 1000, Green 1010, and Blue 
1020 slides contain a TOoatControl Command. 'ITicsc 
commands contain a single floating point value which the 
control displays. As the user adjusts the slider, it updates 
this value and executes the command. 
The selection for the 'ITIoalControlConimand specifies 
the I^etColor command within the Apply 1040 button. One 
of its parameters is set when each TFloatConiroICommand 
Ls executed, i-inally, when the user presses the Apply 1040 
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button, the TSetColor command is executed and the selected 
color 1050 is changed. 

Classes 

The following section dcvscribcs the classes of the controls 
and dialog areas and their primary methods. 

Control 

A control is the user interface to one or more commands. 
The control displays information about a commaad, such as 
its name and whether it is active in the current context. 
Following appropriate user interaction, the control causes a 
command to be executed. When appropriate, the control 
obtains the current value of data the command modifies and 
displays it to the user. It may set a command parameter that 
indicates a new value of this data before executing the 
command. 

Methods to create a selection on the control, with addi- 
tional specification of a command within the control as an 
option. Lookup command is a pure virtual function in order 
to give subclasses flexibility in how many commands they 
contain and how they are stored. 

Methods that are called when ihe presentation is opened 
and closed. When the presentation is opened the control 
connects for notifications that may affect its slate. When the 
presentation is closed these connections arc broken. 

Methods that arc called when the presentation is activated 
and deactivated. When the presentation is activated, some 
controls connect for notifications that arc valid only when 
active. Deactivating the presentation breaks these connec- 
tions. 

Methods that control uses to connect to and disconnect 
from notifiers that affect whether the control is enabled. 
ConnectEnabledNotifiers connects to the notifiers specified 
by commands when the control is opened. Disconnect- 
EnablcdNotifiers breaks these connections when the control 
Ls closed. 

Methods that receive notifications indicating that some- 
thing happened affecting the control's presentation of a data 
value. TTiis method docs nothing by default. 

Methods for notification. Create interest creates an inter- 
est specialized by the control instance. Notify is overloaded 
to send a notification and swallow the interest. 

Ace The Control Interest 

A single notificr is shared among many subclasses of 
controls. In order to express interest in a particular control 
iastancc, the interest must be spccializxd. A control interest 
is an interest that contains a pointer to a specific control. Iliis 
class Ls an internal class that is usually used as is, without 
subcla.ssing. 

The Control Notification 

A single notificr is shared among many subclasses of 
controls. In order to distinguish which control sent the 
notification, the notification must be specialized. A control 
notification is a notification containing a pointer to the 
control that sent the notification. 'ITiis class is usually used 
a.s-Ls, without .subclassing. 

Ilic Control Presenter 

A a)ntri)l presenter wraps up a amtrol so it can be 
contained by a presentation data encapsulator. It. imple- 
ments standard behaviors that all presenter objects imple- 
ment. l1iLs class is usually used as-Ls, without suliclassing. 
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Methods that are called when the presentation is opened 
and closed. They do nothing by default. A subclass must 
implement these methods for the object it wraps. For 
controls, these methods are delegated directly to the control. 

s When the presentation is opened, the control connects for 
notifications that may affect its state. When closed, the 
connections are broken. 

Methods that are called when the presentation is activated 
and deactivated. They do nothing by default. A subclass 

10 must implement these methods for the object it wraps. For 
controls, these methods are delegated directly to the control. 
When the presentation is activated, some controls connect 
for notifications that are valid only when active. When 
deactivated, the connections are broken. 

15 

TControlSelection 

A control selection specifies a single control, and option- 
ally a command within it, that is wrapped in a control 
2Q presenter and stored in a presentation. 

Methods to access a command within the control. These 
may return an invalid value if no command was specified. 

TUniControl 

A unicontrol is the abstract base class for controls that 
present a single command and causes it to be executed 
following appropriate user interaction. Examples of this type 
of control are buttons and checkboxes. 

Methods to specify the command that is presented and 
executed by the control. Notification is sent to registered 
connections when the command is changed. 

Methods the control uses to connect to and disconnect 
from notifiers that affect whether the control is enabled. 
35 ConnectEnabledNotifiers connects to the notifiers specified 
by conmiands when the control is opened. Disconnect- 
EnabledNotificrs breaks these connections when the control 
is closed. 

Method that receives notifications indicating that some- 
40 thing happened affecting whether the control should be 
enabled. UpdateEnabled checks whether the command is 
active and calls Enable and Disable as appropriate. 

Methods that control uses to connect to and disconnect 
from notifiers that affect the control's presentation of a data 
45 value. ConncclDataNotifiers connects to the notifiers .speci- 
fied by commands when the control is opened. Disconnect- 
DataNoUfieis breaks these connections when the control is 
closed. Controls that do not display a data value (e.g. button) 
may override connect data notifiers to do nothing. 

50 

TBulton 

A button is a unicontrol that executes its command when 
pressed. This class is normally used without subclassing; 
just set the command and away you go. 

Methods that are called when the presentation Ls activated 
and deactivated. When the presentation Ls activated, some 
controls connect for notifications that arc valid only when 
active. When deactivated, these connections are broken. 
60 When the presentation is activated, buttons register for key 
equivalent notification. This connect ioii Ls broken when the 
presentation is deaclivated. 

Methods that control users connecting to and disconnect- 
ing from notifiers that affect the control's presentation of a 
65 data value. Connect data notifiers connects to the notifiers 
specified by commands when the control is opened. Dis- 
connect data notifiers breaks these connections when the 
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control is closed. Controls that do not display a data value variables are determined by asking the command when the 

(e.g. button) may override connect data notifiers to do menu item was created. 

nothing. Next, a query is sent to the command object for notifi- 
cation interests as depicted in function block 1220. Each 

The Checkbox s command has four methods to connect for different types of 

A checkbox is the user interface to a command that sets notifications: i) notifications that affect it's name, ii) notifi- 

a Boolean value. Following appropriate user interaction, the cations that affect a graphic, iii) notifications that affect 

checkbox calls a command method to change the value and whether the command is acUve, and iv) nolificaUons that 

executes the command. This class is normaUy used without affect any data. In this case, the menu item just acatcd for 

subdassing; just set the command, its value getter and setter, ihc command connects for active nodficalion. It does this by 

and away you go. passing a connection object to ConncctActive. The com- 
mand is then responsible for connecting the connection 

The Slider object to notifiers affecting whether the command is active. 

, , . i a ' Th^n control is passed to function block 1230 to query a 

A slider Ls a unicontrol that displays a smgle floating point ^^^^^^^^ the enabled state when it is necessary to draw 

value and allows it to be changed followmg appropnate user ^ ^^^^ .^^^ ^^^^ ^ ^^^^ j^^^^ ^^^^ ^^^^ ^^^^ ^^^^^ 

interaction. Examples of sliders were presented m FIGS. 9 "i^Active" for its command. The command looks at what- 

ever system state it wants to and returns whether it is active 

TMultiControl **** depicted in decision block 1240 in the current context 

20 (e.g. some commands only arc active when a particular type 

A multicontrol is the abstract base class for controls that of window is in front, or when a particular type of object is 

present several commands and causes them to be executed selected). Then, a menu item updates its internal state (a 

following appropriate user interaction. Examples of this type Boolean value in each menu item) and appearance as shown 

of control are radio buttons and menus. in function block 1250 and 1260 to match the value returned 

25 by the command. 

TRadioButlon Whenever a user action invokes any command as shown 

A radio button is a multicontrol thai displays two or more in input block 1270, a user causes a command to be 

Boolean values and allows them to be changed following executed. This could be from a menu item, control, or 

appropriate user interaction. The radio button enforces the through direct manipulation of an object. TTiis action causes 

constraint that exactly one button is selected as shown in a document sUte to be modified as shown in fimction block 

FIG. 11. If Paper is selected, then the circle at 1100 is 1280, and a document sends notification as shown in func- 

blackcncd. If Plastic is selected, then the circle at 1110 is tion block 1290. When a document sends noUfication, the 

selected. Both cannot be selected. following steps are executed: 1) any menu item (or other 

control) connected for the notification sent by the document 

TCommand receives a notification message. This message includes the 

J i . * « „t,:„«* c„t «f name of the change as well as a pointer to the object that sent 

Acommand enc«psulales a requ^^^^^ rImS a e us^ 'he nolif,cation) a menu item then updates iU state, and 

object, to perform a parucular action. Comm nds are usu- J ^ ^^^^^.^^ ^^30 for further 

ally executed m response to an end-user action, .such as , *^ 

pressing a button, selecting a menu item, or by direct processing. . , , . j • . 

manipulation. Commands arc able to provide various pieces FIG. 13 is an illustration of a display m accordance with 

of information about themselves (e.g. name, graphic, key the subject invention. The menu item is Edit 1300 and has 

equivalent, whether they are active) that may be used by a a number of submenu items associated with it. Undo 13 lU 

control to determine iU appearance. Subclasses must imple- is an active menu item and can thus be selected to carry out 

ment a method to examine the current selection, active user 45 the associated functions. Redo 1320 is inactive and is thus 

interface element, or other parameters in order to decide presented in a greyed out fashion and cannot be setected at 

whether the command is acUvc. Subclasses must override this time. A checkbox is also shown at 1360 as part of the 

gel active interest list to return notification interests that may debugging control panel 1350. 

affect whether this command is active ^ . . Presentation Templates and Persistence 

RG. 12 is a flowchart depicting the dcUiled logic in 50 

accordance with the subject invention. The flowchart logic Data presentations arc created from templates and saved 

commences at 1200 and control pa.sses directly to function across sessions in a user interface object. The container for 

block 1210 where a command objects are added to a menu. all data in the system is a model. A model contains and 

The steps carried out by this function block are: I) create faciliUtes the manipulaUon of data. Data exchange is facili- 

mcnu item from a command, where a menu item is another ss »ated through cut, copy, and paste opcratioas. Data reference 

object data structure containing a command, 2) add a menu Ls provided by selections, anchors, and links. Data models 

item to a list of menu items, and 3) mark the menu's may be embedded into any other. Users interact with rnodcis 

appearance Ls invalid in data structure fvalid. Then, later through presentations (e.g. icon, thumbnail, frame, window, 

when tlic menu is pulled down, the appearance Ls rccom- dialog, control panel) that arc provided by an associated user 

putcd based on the system .state. eo interface. Data models dctegate all presentation creation and 

Each menu Is a view. Views contain size and location access methods to another object, called the user interface, 

information. Each menu contaias a list of menu items. Each A user interface is a model containing a set of prcscnta- 

mcnu item contains a command and variables that reflect its tions (e.g. icon, thumbnail, frame, window) for a particular 

current appearance. 'Hiis includes whether the menu item is model. When required, presentations are selected from those 

enabled (Boolean l Enabled), its name (TlcxtUbcl fNamc), 65 already created based on the type of presentation desired, the 

its graphic ( TGraphicUbcl fGraphic), and whether its user's name, locale, and other criteria. If the desired pre- 

appcaranccisciirrcntly valid (Boolean fValid). Each of these scnUtion is not found, a new presentation is created and 
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added to the user interface by copying one from an associ- 
ated archive. Presentations may be deleted when persistent 
prcvsentation information (e.g. window size and location, 
scroll positions) Ls no longer required. 

A presentation contains a set of presentable objects that 
wrap user interface elements (e.g. menus, windows, tools) 
used to view and manipulate data. Presentations provide a 
reference to the data these objects present. Presentations 
iaslall or activate presentable objects when the presentation 
is activated. Similarly, these objects arc removed or deacti- 
vated when the presentation is deactivated. Presentations arc 
identified according to their purpose (e.g. icon, thumbnail, 
frame, window) and retain yet-to-be-determined criteria 
(e.g. user identity) for later selection. 

A presentation is made up of a collection of presentable 
objects (e.g. user interface elements) that are. displayed on 
the screen or arc otherwise available when the presentation 
Ls open or active. 

Presentations are created from template presentations 
contained in an archive. These arc made up of objects such 
as user interface elements, which are, in turn, made up of 
smaller objects such as graphics and text strings. 

An archive is a model containing a set of template objects, 
including user interface elements (e.g. windows, menus, 
controls, tools) and presentations (e.g. icon, thumbnail, 
frame, window). 

Dialog Boxes & Control Panels 

By using command objects in different ways, we can 
control two independent behaviors of a group of controls. 
The first is whether they affect the data immediately, or 
whether the user must press OK before the settings take 
effect. The second is whether they arc independent from one 
another, or whether the sellings represent an atomic opera - 
lion. 

Controls contain commands. As the user manipulates the 
contml, the control sets parameters in the commands and 
cause it to be executed. Commands operate on model data 
specified by a selection. 

Immediate 

Controls that affect the data immediately contain a com- 
mand that contains a selection that specifies real model data. 
As the user manipulates the control, the command causes 
this data to change. As the data changes, it sends change 
notification so that views and controls depending on the state 
of the dala can accurately rcfiecl the current state. 

Delayed 

Controls that arc designed lo-not change the real data 
must operate on prototypical data, iastead. The real model 
data Ls not changed until the user performs another action, 
such as pressing the OK button. This is accomplished in two 

ways: 

The control contains a command that contains a selection 
that specifics the control itself. As the user manipulates the 
control, the command causes the conUol's value to change, 
but no other model data. When the user presses OK, a 
command in llie OK t)ull()n changes Ihc real model data to 
match tlie values in each contrx>l the user may have manipu- 
lated. 

'Uic control contains a command that contains a selection 
that specifics a parameter of the command a>ntained by the 
OK buttt)n. As the user manipulates the control, the com- 
mand causes the OK button's command to change. When the 
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user presses OK button, the OK button's command changes 
the real model data to match the values contained in itself. 

Independent 

Controls that act independently from one another require 
represent actions that can be individually undone after the 
control panel or dialog session is complete. This is the 
normal behavior of commands once they are executed by 
controls. 

Atomic 

Other sets of controls arc designed to work together and 
should be undone and redone as an atomic operation. This is 
accomplished by pulling a mark on the undo stack when the 
dialog box or control is started. When finished, either by 
dismissing the control panel or when the user presses an OK 
button (as in n B above), all of the commands executed since 
the mark was placed on the undo stack are collected together 
into a single command group. This group can then be undone 
or redone as a single group. 

CANCEL 

Control panels containing a CANCEL button (usually 
accompanied by an OK button, as in II B above) us a 
technique similar to that described III B above. A mark is put 
on the undo stack when the dialog box or control panel is 
started. If Ihe user presses the CANCEL button, all com- 
mands placed OD the undo slack since the mark are undone. 
This technique works regardless of whether the controls 
affect the data immediately or not. 

Atomic Command Execution in Dialog Boxes 

The object with which users interact to manipulate other 
objects or data is called a control. Example controls are 
menus, buttons, check twxes, and radio buttons. Each con- 
trol contains a command, which implements an end-user 
action. Commands operate on dala that is specified by a 
selection object. As the user manipulates Ihc control it sets 
parameters in the command and causes it to be executed, 
thus changing the data value. 

Controls that act independently from one another require 
represent actions that can be individually undone after the 
control panel or dialog session is complete. This is the 
normal behavior of commands once they are executed by 
controls. Other sets of controls are designed to work together 
and should be undone and redone as an atomic operation. 
This is the subject of this patent. 

llie detailed logic of the atomic execution is set forth in 
the flowchart presented in FIG. 14. Processing commences 
at terminal 1400 where control is immediately passed to 
function block 1410 where a dialog box is activated. When 
the dialog box is activated, a mark is placed on the undo 
slack. The undo stack Ls a list of all commands Ihe user has 
executed. When undo is pressed, the command on the lop of 
the slack Ls undone. If not immediately redone, it is thrown 
away. Then, at function block 1410, a user manipulation of 
a control is detected. Tlie manipulation of a a>ntrol changes 
the command's dala value, as appropriate as set forth in 
function block 1430, and executes the control. For example, 
a checkbox toggles the command's fchecked field between 
0 and 1 . Finally, the command is recorded on the undo stack 
so it can be subsequently undone as shown in function block 
1440. 

As a user subsequently manipulates each control in the 
dialog box, as detected in decLsion block 1450, then control 
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passes to function block 1430. However, if a user presses Disabled 

OK as detected in decision block 1460, then control passes ^ j^.l 

* r ui 1 AA'yts, r- 11 „u^« ;« Con rol abeLs are dimmed when the control does not 

to function block 1420. Finally, when each control m the . . , , . . ^ . • , . , i ... ... 

,. , . . , 4 *L . *vr*^** #1,- ..c- apply ma particular context. Graphic labels are blended With 

dialog box IS set to the user s satisfaction, the user presses ... i...- * . j- .r- 

.u /-.Tr u .4 All r.L j„ „^ ^*u^ I, r 46% white when inactive, m order to appear dimmed. For 

the OK button. All of the commands executed since the mark S ... , , ^ 

was placed on the undo stack in function block 1440 arc text labels, the disabled paint ,s dcnved from the naO^a 

collected together into a single command group and placed P*!"' ''y manipulating the saturation component of the HSV 

back onto the undo stack as depicted in function block 1470. f\ multiplied by 0.54 when 

A command group is a command that collects many com- * 

mands together. When executed, undone, or redone, the lO Selected 
command group executes, undoes, or redoes each command 

in sequence. The command group is then placed back onto Control labels are highlighted as the control is being 

the undo stack where it can be undone or redone as a single manipulated. Graphics and text are drawn in their natural 

atomic operation. state, but on a white background, when highlighted. 

Delayed Command Execution in Dialog Boxes " Smart Control Labels 

Tlie object with which users interact to manipulate other Controls use a command to determine the current state of 

objects or data is called a control. Example conlroU are ^^ject or data. FoUowing appropriate interactions with 

menus, buttons, check boxes, and radio buttons. Each con- j^,^ command's parameters and 

trol contams a command, which miplemenis an end-user 20 ,^ ^ executed. For example, a checkbox sets a 

action. Commands operate on data that is specifieji by a ^^^^^^^ parameter to on or off and then executes the 

selecUon object As the user manipulates the control it sets command to change a data value. Cbntrols display a label to 

parameters m the command and causes it to be executed. j^^j^^j^ j^^^, , ^j^^, ^^ject con- 

thus changing the data value. Delaying changmg of data ^ „^ ^ ^^^^^^ ^ 

unul the user pcrfoms another acUon is one asped of the 25 ,„,„^aUcally adjusts its appearance, without 

subject invention. I-or example controls in a dialog box may developer to write additional code. These states 

not want to change any data values unUl the user presses the .^^^^^^ active/inactive, enabled/disabled, and selected/ 

unselccted. 

When a control is created a command must be specified. jg ^^^^^ associated with smart 

The control makes a copy of this command and stores it in , . . . ... * * * • i «cnn 

.cur J ir.L J 1- J « 1 label processing which commences at the start ternunal 1500 

field fcommand. If the command supplies any data values, a , * i - • j- . i ismf * ■ u i 

. ^ , , „ . J f \i where control is immediately passed to 1510 for smart label 

pointer to appropriate Get and Set methods 01 the command . ..... * • • * ^ •* i u i • ■ • 

^ i i i^i' K** , , . ... mitializalion. When the control is created, its label is im- 

must also be specified. The control stores these method ^.^ ^ ^^^^ ^^^.^^^ 

pointers in fields fGetMelhod and fSetMelhod, respecUvely. command. Each command provides methods called 

The data that is inodificd by a command is speaficd by a ^5 ^^^^^^^.^ ^^^^^^ ^ ^^^^^^j 

selection object. Nornially, this selection object specifies ^^^^^ ^^^^^^^ ^ ^ ^^^^^ .^^^^^^ 

real model data. Instead, a sclecUon object that specifies the ^^^^^ SetActivc. Similarly, the control calls method Set- 
data value withm the command of the OK button. ^^^^^^^ ^^jj ^j^^^j^^^ ^^^^^^^^ 

When a u.scr manipulates the control, the control's com- ^^^^^^ i^,,^! whether it Ls currently being selected 

mand is executed and a data value within the command of ^ ^ 

the OK button is changed. As the user manipulates each -m. . . • ^ i u i * a »■ 

. 1 • 1- 1 L <i. .1. J- .J I ne next step m smart label processing occurs at function 

controlinthcdiabgbox, the control s command IS executed , .u i u i • -j \Tru ,u . i • 

. , . , . V, , f u.M bock 1520 when the label is drawn. When the control is 

and a data value withm the a)mmand of the OK button is . j n i-. *u j r ■ . i • 

. , ™ . a rttr u M .u activated, it calls the Draw method of its label, causing the 

changed. Tlius, when a user presses tlic OK button, the , . , < ,t_ - *• i i. i • j 

J • /Mr I I i 4U I I 1 I * # 45 label to appear on the screen. If inactive, the label is drawn 

command in the OK button updates the real model data to y ^l. i tx.- • j l • i *c 

... , • J ...... ir ■ 1 - J more dimly than normal. This IS done by manipulating the 

match the data values contamed within itself as manipulated "7"^ """'J' uuiiucu y a i ^ * 

1 rj^' /j * i saturation components of the HSV color model. The satxi - 

by the control s commands. This processing LS repeated until i- j i_ ac u • ir j- ui j iu 

control rocessin Ls com Ictcd *- niion is multiplied by 0.45 when inactive. If disabled, the 

con ro processing ls comp c c ^^^^^ ^ drawn more dimly than normal. This is done by 

labels 50 manipulating the saturation components of the HSV color 
I^l>els are graphical objects that contain a graphic or text 5«iluralion is multiplied by 0.54 when the label 
string. Tliey are used to identify windows, menus, buttons, »^ disabled. If selected, the label on a highlighted back- 
and other a>ntrol.s. labels are able to alter their appearance g^y^^' ^^^^^l .""^"^ f uT '"^^'""^•^ay 
according to the state of their container. They are drawn on background. When highlighted labels are drawn or, a white 
a medium-gray background and appear naturally only when background. Otherwise, the label is drawn normally- 
no special state must be indicated. Labels modify their The next processing occurs when a label is acUvated/ 
appearance when inactive, disabled, or selected. deactivated as shown in function block 1530. When the 

control is activated or deactivated, it tells the label by calling 

Inactive (j^e SeLAclive method. The control then indicates its appear- 

Window titles arc set to be inactive when the window is 60 ance needs updating by calling Invalidate with an argument 

not front-most. Similarly, control labels arc set to be inactive indicating the portion of the screen that needs to be redrawn, 

when the control is not in the front-most window or other 'Ihen, at function block 1540, processing occurs when a 

container. Graphic labels arc blended with 55% white when control is enabled/disabled. When the control is enabled or 

inactive, in order to appear dimmed, i'br text lat:)eLs, tlic disabled, it tells the label by caUing the Sctlinabled method, 

inactive paint is derived from the natural paint by manipu- 65 'Hie control then indicates its appearance needs updating by 

lating the saturation oomponcnt of the HSV color model. calling Invalidate with an argument indicating the portion of 

Ihe saturation Ls multiplied by 0.45 when inactive. the screen that needs to be redrawn. 
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A test is then performed at decision block 1550 to or graptiic is redrawn on a recessed background. If the 

determine if a control is selected or unsclected. When the button Ls inactive, such as when another window is active, 

control is selected or unselecled, it telLs the label by calling the text or graphic of the button could be drawn dimly on a 

the SctSclcctcd method. TTic control then indicates its flush background, 
appearance needs updating by calling Invalidate with an 5 

aigumcnt indicating the portion of the screen that needs to Borders 

be redrawn, and control is passed to function block 1520 for . . iu * — j .i. u- 

' . A decoration that surrounds another object or area is 

lurtncr processmg. called a border. Example borders are frames and shadows. A 

c -4 \\r A r u I frame is a border that surrounds another graphic, much like 

Smart Wmdow Labels lo - , ... 

a frame encloses a pamtmg in the real world. Like 

A title is displayed in a window in order to indicate its backgrounds, frames can bedrawn to appear recessed below, 

purpose. For example, the title for a window to edit a flush with, or raised above a surrounding drawing surface. A 

document is usually the name of the document. A label shadow is a special type of border that adds a shadow around 

object is used to keep track of the title. This label is a an object to make it appear as if it floats above the sur- 

graphical object containing a graphic or a text string. As the rounding surface. 

window changes state, the label automatically adjusts its 

appearance, without requiring the developer to write addi- Decoration Colors 

tional code. Windows can be either active or inactive. Smart ^. r.L • i * r ■ . r i 
iw J 1 L . • rt u . J • i-i^ i ^ J Many of the visual aspects of user interface elements arc 
Window label processmg is nowcharted m FIG 16 and the ^ ^^^J^ "^.i^^^nXs, Examples are shadows, 
detailed logic is explained with reference thereto. ^^^^^^^^ ^^^^^ ^^^^ ^^^^^ individual visual features 
Processing commences in I IG. 16 at terminal 1600 where referred to as a decoration. Decorations can be combined 
control is immediately passed to function block 1610 for the ^^j, ^^^^ graphics to form the visual appearance of specific 
title to be initialized. A window liUc is specified by a ^^^^ interface elements, such as windows and controls, 
developer when a window is created. This title is stored in ^ ^^^^ decorations use highlighting and shadows lo appear as 
a TL^bcl object called (Title. The control tells the tide jf t^cy are above or below the surrounding drawing surface, 
whether it is currently active or inactive by calling method Decorations arc able to derive automatically these highlight- 
Set Active. Then, the at function block 1620. When a win- jjjg and shadow paints, 
dow is drawn, it calls the Draw method of its fTitle object, 

causing the title to appear on the screen. If inactive, the title Fill Paint 
is drawn dimmer than normal. This is done by manipulating 

the saturation components of the HSV color model. The The fiU paint represents the decoration's primary color 

saturation is mulUpUed by 0.45 when inacUve. Otherwise, All other paints arc derived from the fill paint. The fill pamt 

the tide is drawn normally. ^ stored by the directoration in a TColor field called 

THe next step is processed at function block 1630 when 35 ^^^^^^If '^^^^^ is normally specified by the devel- 

the title Ls activated/deactivated. When a window Ls acti- opot;^cn the decoration is created. However, if no color is 

vated or deactivated, it tells its ftitle object by calling the ^P^'^^*^^' ' S'^V ^ 

SctAclivc method. The window then indicates its appear- Frame Paint 
ance needs updating by calling Invalidate with an argument 

indicating the portion of the screen that needs to be redrawn. 40 The frame paint Ls used to draw a line around the 

Then, control is passed back to function block 1620 for decoration to provide visual contrast. The frame paint is 

rctlrawing the title to reflect its new state. stored by the decoration in a TColor field called fPrame- 

Painl. The frame paint may be specified by the developer 

Decorations when the decoration is created. However, if no tiame paint 

Many of the visual aspects of user interface elements are « '^P^^'^- i' "™P"'^'' automaUcally from the fill paint 

common among many elements. Examples are shadovvs, accomphshed by man.pulaUng .be satur.Uoo and 

bo«lcn5. and labels. -ITie individual visual features ate value components of the HSV color model. The sal^^^^^^ 

referred to as decoraUons. Decorations can be combined """"^Pj^J four, with a maximum value of 1. TTie value 

with other graphics to form the visual appearance of specific »s ivi e y our. 

user interface elements, such as windows and controls. The Hinhliiiht Paint 
subject invention supports many diff"crcnt types of decora - 

tioas. The highlight paint is used to draw lines where light 

would hit the object if it were an actual three-dimensional 

Backgrounds object. The highlight paint Ls stored by the decoration in a 

A decoration that is drawn behind anoUicr object Ls called TColor field called mighlighlPaint. The highlight paint may 

a background. One type of background Ls drawn so as to specified by the developer when the decoration ts created^ 

appearflush with the surrounding drawing surface. It may be however, if no highlight paint is specified, it is computed 

drawn with or without a frame. Another type of background ^"toniatically rom the fill paint. Tins ls accon.plLsl.ed by 

Ls drawn wiUi highlighting and shadow so it appears be '"Saturation and value u)mponents of the 

rai.sed above the surrounding drawing surface. The final type "^J^ 'i"*"^ . y^^"*"^*^!"" ^ "i"J»»P»'<^J ^y 0.8^ Fhe 

of background is drawn with highlighting and shadow so it multiplied by 1 .25, with a maximum value of 1 . 

appears to be recessed beneath the surrounding drawing Shadow Paint 
surface. 

An example u.sc of these backgrounds is a button. Nor- 65 'I^e shadow paint can be used to draw lines where the 

mally the text or graphic that describes the button is drawn object would be shaded if it were an actual three- 

on a rai.sed background. When pressed by the user, the text dimensional object. The shadow paint is stored by the 
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decoration in a TColor field called fShadowPaint. The If selecting, the Interaclor compares the current' mouse 

shadow paint may be specified by the developer when the location with the initial mouse location. The current mouse 

decoration is created. However, if no shadow paint is location Ls obtained by calling the GetCurrentLocation 

specified, it is computed automatically from the fill paint. method. The initial mouse location is obtained by calling the 

This is accomplished by manipulating the saturation and S GetlnilialLocation method. If the two are the same or differ 

value components of the HS V color model. The saturation is by only a small amount, the user is still selecting the object, 

multiplied by 2 with a maximum value of 1. The value is The Interactor then asks the Interactable to continue the 

divided by 2. selection operation by calling its SelectRcpcat method. 

However, if the two points differ beyond a predetermined 

Separating Input Syntax From Semantics jo threshold, the user has begun moving the object. In this case, 

A graphical user interface is manipulated by moving a the Intaractor adcs the Interactable to terminate the selection 

mou^, clicking on objects to select them, dragging objects operation by caUmg its SclcctEnd method. It then asks the 

to move or copy then, and double-clicking to open them. InleracUble to begin the move operation by callm^ its 

These operations arc called direct manipulations, or inter- MoveBegin method. In each case the current mouse loca- 

actions. The sequence of events corresponding to a user is Uon is passed as an argument. If Mo ving, the Interactor asks 

pressing, moving, and releasing a mouse is called an input t^e Interactable to continue the move operation by callmg its 

synux. Certain sequences of events are used to indicate MoveRepeat method. It passes the current mouse location as 

particular actions, called semantic operations. argument. 

The separation of the code that underetands the input When the user releases the mouse buUon, it signals the 

syntax from the code thai implements semantic operations is ^ end of the current operation. If SclccUng, the Interactor asks 

the subject of this patent. This processing is embodied in the Interactable to terminate the selection operation by 

objects called Interacts and Intractable, respectively. FIG. 17 calling its SelectEnd method. If movmg, the Inleractors asks 

illustrates how these objects arc created and how the objects Interactable to terminate the move operation by calhng 

communicate with each other during a typical interaction its MoveEnd method, 

with an object that can be moved and selected. " Localized Presentations 

Processing commences at terminal 1700 where is control 
is passed immediately to function block 1710 to determine Localization is the process of updating an application to 
if the mouse button has been pressed. An event is sent to the conform to unique requirements of a specific locale. It may 
object responsible for the portion of the screen at the involve language translation, graphic substituUon, and inter- 
location where the mouse button was pressed. This object is face clement reorientation. For example, the text used in 
called a View, Then, at function block 1720 the Interactor is labels, titles, and messages depends upon the selected Un- 
created to parse the input syntax. This is done by calling the guagc. Its direction and orientation may affect the placement 
Crcatelnteraclor method of the view. When the Interactor is and orienUtion of a menu, mcnubar, title, scroUbar, or 
created, pointeis to objects that implement possible user toolbar. Similarly, the selection of icons and other graphical 
actions arc passed as parameters. symbols may be culturally dependent. Unfortunately, having 
For the purposes of this discussion, assume the user many localized versions of user interface elements in 
pressed the mouse button down on an object that can be memory is very expensive. Instead, localized versions of 
selected and moved. In this case, an object that implements "scr interface elements are kept on disk until required m 
selection and an object that implements movement for the memory. 

target object are passed as parameters to the Interactor. The Further, it is very error-prone and expensive to keep track 

initial View could implement both of these behaviors, or of all of the user interface elements and decide which 

they could be implemented by one or two separate objects. version to use. Instead, when a user interface element is 

I'hc object or objects are referred to collectively as the required, the appropriate one is selected automatically by the 

Interactable. 45 system, according to the current language and other cultural 

ITic interactor Ls started at function block 1730. This parameters and read into memory, 

processing returns the Interactor to the View and com- Once localized, user interface elements are stored in a 

mcnccs processing of the Interactor. Tills is accomplished by disk dictionary. A disk dictionary is an object that, when 

calling the Interactor 's Start method and passing the initial given a key, returns a value after reading it in from disk. This 

mouse event as a parameter. The Start method saves the 50 disk dictionary is managed by an object called an archive, 

initial mouse event in field finilialEvenl Since only one An archive Ls rCvSponsible for putting together the individual 

mouse event has been processed thus far, the only action u.ser interface elements that make up a particular prcsenta- 

possiblc Ls selecting. The Interactor enters select mode by lion. The process of selecting the proper user interface 

.setting variable fInteractionTVpe to constant kSelecl. It asks clement Ls presented in FIG. 19. 

the Interactable to begin the selection operation by calling its 55 Processing commences at terminal 1900 and immediately 

SclectBcgin method. passes to function block 1910 when a user requests a 

Ihcn, the Interactor waits for a short lime to pass as presentation. A TOpcnPresenlation Command is sent to the 

shown in function block 1740. A new mouse event is sent to data model, indicating that the user wants to view or edit this 

the Interaclor when the lime is up which indicates the cunrcnt data. A command is sent to the data model to indicate that 

.statcofthemouse.l^icn, if the system detects that the mouse 60 the u.scr wanLs to view or edit the data. 'IliLs command is 

is .still down at decision block 1750, control is passed to called a TOpcnPresenlationCommand. A presentation is a 

function block 1740. OthcrwLsc, control Ls passed to tcnni- set of user interface elements that, together, allow the user to 

nal 1760. If the mouse button Ls still down, the interactor view or edit some data. Presentations arc stored across 

makes sure it is still in tlic concct .slate and a.sks the scvssions in User Interface object, thus maintaining continu- 

Intcractable to implement the correct operation. The Inter- 65 ity for the user. User interface elements are stored on disk 

actor is Selecting if flnlcractionlVpc Ls ksclccting. It is until needed in memory. They may be required as part of a 

Moving if tlic flntcractionlVP^^ i-** k Moving, data presentation the user has requested, or they may be 
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needed for translation or another localization process. Each 
user interface element conlaias an ID which uniquely ref- 
erences that element. However, all localized versions of the 
same user interface clement share a single ID. 

In order to differentiate the localized versions, this par- 
ticular language, writing direction, and other cultural param- 
eters arc stored with each localized user interface element. 
Together, these parameters are referred to as the locale. All 
of the user interface elements arc stored in a file. This file is 
organized like a dictionary, with one or more keyA'alue 
pairs. The key is an object which combines the ID and the 
locale. The value is the user interface element itself. 

A new presentation must be created next at functions 
block 1920. If an appropriate presentation docs not already 
exist, a new one must be created from a template by the user 
interface Archive. A new presentation is created from a 
template stored in the archive by calling its CreatePresen- 
tation method. A presentation type is passed to this method 
as a parameter This type includes such information as the 
type of data to be displayed, whether it is to be in its own 
window or part of another presentation, and so on. Finally, 
at function block 1930, an Archive builds the presentation, 
selecting user interface elements according to locale. If the 
Archive is able to build a presentation of the specified type, 
it collects together each user interface clement that makes up 
the presentation and returns this to the user interface object. 

For each presentation the archive is able to make, it has 
a list of user interface clement IDs that together make up the 
presentation. The user interface elements arc stored on disk 
maintained by a disk dictionary object called. Given a key, 
the disk dictionary vdll return the corresponding user inter- 
face element. The user interface clement ID makes up the 
primary component of this key. A secondary component of 
the key is the desired locale. A locale is an object that 
specifies the natural language and other cultural attributes of 
the user. The locale obtained automatically by the Archive 
from a Preferences Server This server contains all of the 
individual preferences associated with the user 

The locale, as obtained from the preferences server, is 
combined with the ID into a single object called a TUse- 
rlnlcrfaceElemenlKey. This key passed as a parameter to the 
GetValue method of the disk dictionary. If a user interface 
clement with a matching ID and locale is found, it is returned 
and included as part of the presentation. Otherwise, the 
locale parameter must be omitted from the key, or another 
locale must be specified until an appropriate user interface 
element is found. 

Interaction Framework System 

Users of an object oriented operating system's graphical 
user interface often move a mouse, click on objects to select 
them, drag objects to move or copy then, and double -click 
to open an object. 'Hicsc operations arc called direct 
manipulations, or interactions. 'Die sequence of events cor- 
responding to a user pressing, moving, and releasing the 
mouse is called the input syntax. Certain sequences of events 
are used lo indicate particular actions, called semantic 
opcratioas. 'Iliis invention discloses the method and appa- 
ratus for tran.slating input syntax into semantic operations 
for an object that supports Select, Peck, Move, AutoScroll. 
and Drag/ Drop (Copy). 

I^he invention detects a mouse button depression and then 
employs the following logic: 

(a) If an Option key was depressed when the user pressed 
the mouse button, the system enters drag mode by 
setting variable flnteraction'I^pe to constant kDrag. 
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The system then commences a drag operation using the 
selected object as the target of the operation; or 
(b) if the Option key was not depressed, then the system 
enters selection mode by setting variable flntcraction- 
5 Type to constant kSelect Then, the select operation is 
commenced. 

If a user already had the mouse button depresses and 
continues to bold the mouse button dow^n, then the following 
logic is engaged. If the system is in select mode, then the 

10 system first determines whether the user has moved the 
mouse beyond a certain threshold, called the move thresh- 
old. This is done by comparing the initial mouse location, 
returned by the GetlnitialLocation method, with the current 
mouse location, returned by the GetCurrentLocation 

IS method. If the mouse has moved beyond the move threshold, 
the system ends select mode and enters move mode. It does 
this by setting variable flnleractionlVpe to constant kMove. 
The system then queries the object to terminate the select 
operation by calling its SclcctEnd method. The system then 

20 initiates a move operation by calling its MoveBegin method. 
Otherwise, if the mouse has not moved, the system checks 
how long the mouse has been down. It does this by com- 
paring the initial mouse down time, returned by the Getloi- 
tialTime method, with the current time, returned by the 

25 GetCurrentTime method. If the mouse has been down 
beyond a certain threshold, called the peek threshold, the 
system ends select mode and enters peck mode. It does this 
by setting variable flnteractioniype to constant kPeek. It 
asks the object to end the select operation by callings its 

30 SelectEnd method, and begins a peek operation by calling its 
PeekBegin method. Otherwise, if the mouse has not moved, 
or it has not been down beyond the peck threshold, the 
system continues the select operation by calling the object's 
SclcctRcpcat method. If the system detects that a user is in 

35 Move mode, the system first determines whether the user has 
moved the mouse within the window, on the border of the 
window, or outside the window. It does this by comparing 
the current mouse location, returned by the 
GetCurrentLocationMethod, with the bounds of the object's 

40 container, returned by GetContainerBounds. 

If the mouse is still within the bounds of the window, wa 
the system continues the move operation by calling the 
object's MoveRepeat method. If the mouse is on the border 
of the window, this indicates an AutoScroll operation. The 

45 system asks the object's container to scroll in the direction 
indicated by the mouse location. This is done by calling the 
container's AutoScroll method and passing the current 
mouse location as a parameter. Once complete, the system 
continues the move operation by calling the object's Mov- 

50 cRepeat method. 

If the mouse has moved outside the window, the system 
ends move mode and enters drag mode. It does this by 
setting variable flnteractionType to constant kDrag. It asks 
the object to end the move operation by calling its Move End 

ss method. It asks the object to begin the drag operation by 
calling its DragBegin method. If the system is in drag mode, 
the system continues the drag operation by calling the 
object's DragRcpcat method. If the system is in peek mode, 
the system first determines whether the user has moved the 

60 mouse beyond a certain threshold, called the move thresh- 
old. This is done by comparing the initial mouse location, 
returned by the Gctlnitiall^cation method, with the current 
mouse location, returned by the GetCurrcntl^cation 
mctliod. 

65 If the mouse has moved beyond the move threshold, the 
system ends peck mode and enters move mode. It docs this 
by setting variable nntcraction'IVpe lo constant kMovc. It 
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asks the object to end the peek operation by calling its 
PcekEnd method. It asks the object to begin the move 
operation by calling its MoveBegin method. Otherwise, if 
the mouse has not moved, the system continues the peck 
operation by calling the object's PeekRepeat method. 

If the system detects that a user releases the mouse button, 
then if the system is in select mode, the system ends select 
mode. It does this by setting variable flnteractionlVpc to 
constant kNone. The system queries the object to end the 
select operation by calling its SclcctEnd method. If the 
system is in move mode, the system ends move mode. It 
does this by setting variable flntcractionlVpe to constant 
kNone. Then, the system queries the object to end the move 
operation by calling its MoveEnd method and ends drag 
mode by setting variable flntcractionlVpe to constant 
kNone. It asks the object to end the drag operation by calling 
its DragEnd method. If the system is in peek mode, the 
system ends peek mode. It does this by setting variable 
flntcractionTVpc to constant kNone. It asks the object to end 
the peek operation by calling its PeekEnd method. 

Accordingly, it is a primary objective of the present 
invention to provide an innovative hardware and software 
system which enables the contents of a window to update 
dynamically as a user moves a scrollbar thumb. The system 
detects when a user presses down on a scrollbar thumb. 
When the user presses down on the scrollbar thumb, the 
system begins initiation of a scroll command to change the 
portion of the data that is exposed in the window. A 
command in an object (hat implements an end-user action, 
such as scrolling. A scroll command has one parameter, the 
position to which the content view should be scrolled. The 
system sets this position to the current scroll position. This 
is accomplished by calling the command's SclScroll Position 
and setting the scroll to position to the value returned by the 
scrollbar's method GctScrollPosition. 

When a user moves the mouse within the scrollbar, the 
system continues the execution of the scroll command to 
dynamically change the portion of the data exposed in the 
window. The system sets the scroll position of the command 
to the new scroll position. This is accompli.shed by calling 
the command's SetScrollPosition and setting the value equal 
to the value returned by the scrollbar's method GelScroll- 
Position. The execution of the command is then repeated by 
calling its DoRepeat method. This causes the content view 
to scroll to the new position. This processing is continued 
while a user continues to hold the mouse button down. 

When a user releases the mouse button, the system ends 
the execution of the scroll command to dynamically change 
the portion of the data exposed in the window. The system 
sets the scroll position of the command to the final scroll 
position. This processing is accompILshcd by calling the 
command's SetScrollPosition and setting it equal to the 
value returned by the scrollbar's method GctScrollPosition. 

I'IG. 20 is a flowchart illustrating the detailed logic 
associated with scrolling in accordance with the subject 
invention. Processing commences at terminal block 2000 
and immediately pa.sscs to function block 2010 where the 
current scroll position Ls initialized based on the current 
cursor location. 'ITien, at decision block 2020, a test is 
performed to detect if the scrollbar thumb has been selected. 
An example of a scrollbar thumb is shown in RG. 2IA at 
label 2110. If the scrollbar thumb has been selected, then 
control passes to dccLsion block 2030 to determine if the 
scrollbar tliunib has been moved. If so, then the scroll 
position is set to the new position of the scrollbar thumb and 
the display is reformatted to reflect (he immediate scroll 
operation and displayed for the user. If the scrolibar thumb 
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has not moved, another test is perfonmed at decision block 
2050 to determine if the scrollbar thumb has been released. 
If not, then control is returned to decision block 2030. If the 
scrollbar thumb has 620 been released, then control passes 
to function block 2060 to end the scroll operation and return 
the system to a nonscroll operational status and processing 
is completed at terminal 2070. 

FIGS. 21A, 21B and 21C illustrate window scrolling in 
accordance with the subject invention. In FIG. 21 A, the 
scrollbar thumb 2110 is located at the top of the window 
2112. FIG. 21B shows the scrollbar thumb 2120 moved to 
the middle of the window and the window's contents 2122 
updated accordingly. FIG. 21C shows the scrollbar thumb 
2140 moved to the bottom of the window and the bottom 
most portion of the window 2142 displayed. 

While the invention has been described in terms of a 
preferred embodiment in a specific system environment, 
those skilled in the art recognize that the invention can be 
practiced, with modification, in other and different hardware 
and software environments within the spirit and scope of the 
appended claims. 

Having thus described our invention, what we claim as 
new, and desire to secure by Letters Patent is: 

1. An apparatus for use in a computer system with a 
memory and an operating system stored in a system address 
space in the memory, the apparatus providing an object- 
oriented application interface between a user input device 
generating device event signals and an object-oriented appli- 
cation program stored in an application address space in (he 
memory, and comprising: 

(a) an interectablc object instantiated in the application 
address space, the interactable object including a plu- 
rality of methods for manipulating date used by the 
application program; and 

(b) an interactor object instantiated in the system address 
space, the interactor object being respoasive to the 
device event signals for calling a first predetermined 
one of the interactable object manipulating methods to 
change the data. 

2. Apparatus as recited in claim 1 wherein the computer 
system includes a display screen and the interactable object 
includes data defining a graphic for display on the display 
screen. 

3. Apparatus as recited in claim 2 wherein the interactable 
object includes a select method for changing the appearance 
of the graphic on the display by manipulating the graphic 
data. 

4. Apparatus as recited in claim 3 wherein the interactable 
object includes a move method for moving the graphic on 
the display. 

5. Apparatus as recited in claim 4 wherein the user input 
device is a mouse and the interactor object receives device 
event signals from the mouse and calls a method in the 
interactable object. 

6. Apparatus as recited in claim 4 wherein the user input 
device is a keyboard and the interactor object receives 
device event signals from the keyboard and calls a method 
in the interactable object. 

7. Apparatus as recited in claim 1 wherein the interactable 
object is instantiated in the application address space from 
interactable class information stored in the system address 
space. 

8. Apparatus as recited in claim 1 wherein the interactable 
object is instantiated in the system address space from 
interactor class information in the system address space. 

9. Apparatus as recited in claim 1 wherein the interactor 
object is responsive to the device event signals for dctcr- 
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mining an action which is required frona the application instantiates an inleraclable object including a move method 

program and for calling a first predetermined one of the for moving the graphic on the display. 

manipulating methods to perform the required action. 16. A computer program product as recited in claim 15 

10. Apparatus as recited in claim 1 wherein the intcractor wherein the user input device is a mouse and the interactor 
object is responsive to a time sequence of the device event 5 object includes program code for receiving device event 
signals for determining an action which is required from the signals from the mouse and calling a method in the inter- 
applicalion program and for calling a first predetermined one actable object. 

of the manipulating methods to perform the required action. j-; computer program product as recited in claim 15 

11. Apparatus as recited in claim 1 wherein the computer therein the user input device is a keyboard and the inter- 
system includes a display screen and Ihc apparatus further lo ^^^^^ ^^^^^^ includes program code for receiving device 
comprises a view object having means for displaying infor- ^^^^^ ^ , ^^^^ ^j^^ keyboard and calling a method in the 
mation on a portion of the display screen and means m the intractable object 

view object responsive to the device event signals for ^ computer program product as recited in claim 12 

instantiaUDg an interactor object. ^^^^^ ^^^^^ j^^,^^^^ 

12. A computer program product for use m a computer 15 . r f j- .if ■ * * ui i ■ t *• 

J « oroeram code for loading the mteractable class information 

system with a memory and an operating system stored in a m t, ..... 

system address space in the memory, the computer program «^to the system address space program and wherein the 

product providing an object-oriented application interface mtcractablc object mstanUatmg code instanUatcs the mtcr- 

bctwccn a user input device generating device event signals actable object in the apphcaUon address space, 
and an object-oriented application program stored in an 20 19. A computer program product as recited in claim 12 

application address space in the memory, and comprising a wherein the interactable object instanUating code instanli- 

computer usable medium having computer readable pro- ates the interactable object in the system address space from 

gram code thereon, including: intcractor class information in the system address space. 

(a) program code for instantiating an interactable object in 20. A computer program product as recited in claim 12 
the application address space, the interaciable object ^5 wherein the intcractor object is instantiated with program 
including a plurahty of methods for manipulating daU code responsive to the device event signals for determining 
used by the application program; and an action which is required from the application program 

(b) program code for instantiating an interactor object in and for calling a first predetermined one of the manipulaUng 
the system address space, the interactor object being methods to perform the required action. 

responsive to the device event signals for calling a first 21. A computer program product as recited in claim 12 

predetermined one of the interactable object manipu- wherein the interactor object is instantiated with program 
lating methods to change the data. code responsive to a time sequence of the device event 

13. A computer program product as recited in claim 12 signals for determining an action which is required from the 
wherein the computer system includes a display screen and application program and for calling a first predetermined one 
the interactable object instantiating program code instanti- of the manipulating methods to perform the reqiiired action, 
ates an interactable object including data defining a graphic 22. A computer program product as recited in claim 12 
for display on the display screen. wherein the computer system includes a display screen and 

14. A computer program product as recited in claim 13 the computer program product further comprises program 
wherein the interactable object instantiating program code code for instantiating a view object having means or dis- 
inslantiates an interactable object including a select method playing information on a portion of Ihe display screen and 
for changing the appearance of the graphic on the display by means in the view object responsive to the device event 
manipulating the graphic data. signals for instantiating an interactor object. 

15. A computer program product as recited in claim 14 

wherein the interactable object instantiating program code ♦ * * ♦ ♦ 
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